Wipe up the caulk with a water-dampened cloth. You may be unable to remove any caulk this way if the caulk has been on the vinyl for a long time.
Press a razor blade against where the caulk meets the vinyl. Do not apply too much pressure as this might scratch the vinyl. Loosen as much caulk as needed so that you can grasp the end of the caulk.
Grasp the end of the caulk and pull the rest of the caulk off. Because vinyl is generally smooth, the caulk should pull off in one piece.
Press a paint scraper against the wall and slide it against any remnants of silicone caulk that might be on the vinyl. Continue until you've removed as much of the silicone as possible.
Soak a clean cloth in rubbing alcohol.
Lay the cloth over any remaining piece of silicone. Let the cloth sit there for several hours. Tape the cloth down if it is on a vertical surface.
Remove the cloth and wipe up the softened silicone residue.