Locate the fan limit switch on the furnace. It often has a plastic cover on the front with a silver dial against a black casing under it, with a white button in the lower corner. It is usually on the front of the main furnace unit, underneath the draft hood.
Remove the cover to the limit switch. It should just pull off but you may need a screwdriver to unscrew it. Some models have the override button sticking out through a hole in the cover.
Pull out the white button to keep the furnace running regardless of temperature. Push the button back in to allow the furnace to regulate itself and adjust the blower speed from high to low.