Today and tomorrow will stay chilly ahead of a milder weekend