Apply lemon juice or vinegar to the rust stains with a brush or soft cloth. Wait 30 minutes and wipe with a damp cloth.
Mix scouring powder, cream of tartar and hydrogen peroxide together in a bowl to form a paste. Rub the paste on the stains with a brush or cloth.
Wait 30 minutes. Wipe the paste away with a damp cloth and dry well.
Mix a commercial rust remover, according to package directions. Commercial rust removers usually contain oxalic acid, which is a strong acid capable of causing severe skin irritation or burns.
Apply the rust remover to the lantern with a brush or cloth.
Allow the rust remover to remain on the lantern, according to package directions. Wipe the product off with a clean cloth, rinse and dry well.