Shut off the power supply to your Magic Chef furnace by flipping the breaker that controls the furnace circuit to the "Off" position. This breaker is located in the main panel in your home.
Slide the bottom panel on the front of the furnace out, and lift the square-shaped air filter out of the compartment. Inspect the filter for dust, dirt and debris. If there's a significant amount of dirt caked on the filter, then it will need to be replaced. You can do this by sliding a new filter in the old one's place.
Remove any screws on the top access panel of the furnace with your Phillips screwdriver and remove the panel. You now have access to the internal components of the furnace.
Check the pilot light to ensure it's lit. If the pilot light is out, call a professional to relight it.
Check the flame sensor next to the pilot light. This is a metal rod. Ensure the rod is clean. If grime is caked on the flame sensor, use sandpaper to clean the rod.
Flip on the power to the furnace and turn the unit on by setting the temperature higher than room temperature.
Watch the ignitor. This is the fork-shaped component with the ceramic base next to the burner assembly. If the ignitor doesn't heat up and turn bright red, then it's likely damaged beyond repair and needs to be replaced.