Pour vinegar into a bowl big enough to soak whatever silver pieces you need cleaned. Allow the silver to sit for at least two hours. According to My Rust Removal, rust will disappear from silver using this method.
Gently massage rusty spots with a toothbrush and toothpaste. According to Ecocyle, toothpaste makes a great silver cleaner because it contains baking soda, a nontoxic cleaning agent.
Rinse the silver with distilled water once the rust is removed. According to My Rust Removal, this will prevent further damage to the item because plain tap water contains chemicals that are bad for silver.