Connect the two test probes to the voltmeter. The red end should go in the "Volt" socket, and the black into the "COM" socket on a multimeter; on a simple voltmeter, these sockets are marked with a "+" and "-" sign. These are positive and negative polarities respectively.
Set the voltmeter to measure AC voltage, indicated by a "~" symbol. The waveform represents the oscillation of AC polarities. If your meter has variable range, set it to the highest range.
Hold the test probes by their rubber insulation and insert them into the left and right outlet receptacles. Because this is an AC circuit, there is no set polarity so the position of the leads does not matter.
Look at the reading on the voltmeter; you should see a reading of 120 volts, with a 15-volt deviation in either direction.