Purchase oxalic acid, borax, a wooden mixing dowel, plastic paintbrush and a plastic container at a local hardware store.
Mix the oxalic acid in the plastic container with water until it forms a thick paste.
Apply the paste quickly and thoroughly to the mortar with the brush. The paste should have an abrasive cleaning effect on the bricks, and will not harm them if applied there as well.
Allow the paste to cure for thirty minutes to an hour.
Apply borax over the paste; this will nullify the active ingredient in the acid, allowing you to handle it if necessary.
Wash the paste and borax mixture off of the bricks and allow the mortar to dry.