Slide the double-hung windows so both the lower and upper panes of glass are accessible.
Use the putty knife to break off any hardened glaze. If the glaze won’t break off, use the heat gun to soften it and scrape the glaze off.
Hold the caulk canister above the double hung window where the glass meets the wooden frame. Push a 1/8-inch layer of latex caulk onto the edge of the window, over the glass and wood. Push from the bottom of the caulk canister to apply an even layer of caulk. Smooth out the caulk with the flat side of the putty knife into the window's edge. Allow the caulk to dry. Scrape any excess caulk off the window's glass with the sharp edge of the putty knife.
Use the putty knife to cover the caulk with a ¼-inch to ½-inch layer of silicon glaze. Press the glaze into every crack and crevice between the glass and the frame with the putty knife. Dip the putty knife in the mineral spirits and smooth out the glaze with the side of the knife.
Use the sharp edge of the putty knife to cut off any excess glaze from the glass.