the A/C is probably engaged in defrost mode to remove humidity from the cabin and prevent condensation. Even though you don't have AC on it is probably on every time you hit defrost.