Spray the leaves of any affected plants with a spray of water from a hose. The water pressure knocks the gnats off the leaves and prevents further damage to the plant while you deal with the gnat population.
Mix vinegar with several drops of hand soap in a bowl and place it near any affected plants. The scent attracts gnats but the solution also kills them off when they come into contact with it.
Crush any groupings of small gnats that you see by gripping a leaf between your thumb and two fingers and apply pressure, rolling the leaf between the thumb and fingertips. This isn't effective for full infestations but it does kill small numbers of gnats effectively by crushing them. Wear gloves to prevent getting your fingers dirty.
Spritz the plants with an insecticide soap to kill off any remaining gnats left on the plant. Follow all instructions on the package to prevent damage to the plant.