Water your plants slowly with several inches of water to flush out some of the excess fertilizers, including the nitrogen.
Stop feeding your plants with a fertilizer that contains nitrogen for the next two or three feedings. By that time, the nitrogen should be corrected.
Add a thin layer of fine mulch to your garden, such as shredded bark. According to Colorado State University, some of the nitrogen in the soil will be used up as the mulch decomposes.