Remove any oxidation and dirt from the aluminum surface using #1 grade steel wool. Perform the oxidation removal and painting on a cool, dry day. Be careful not to damage the surfaces of the window glass or exterior wall covering such as vinyl siding when using the steel wool.
Wipe off the windows thoroughly with a clean rag and denatured alcohol. Do not use mineral spirits or any other cleaners that will leave a chemical film on the aluminum. Chemicals that leave residue on aluminum will make it difficult for the paint to stick.
Paint or prime the aluminum shortly after you have thoroughly removed the oxidation and cleaned the area with denatured alcohol. Be sure to use a quality exterior paint so the finish will last a long time.