Find the location of any buried gas, water, sewage lines or other wires by employing a locating service.
Extend the chalk line string from where you plan to start the conduit to the conduit's destination. Pull the string tight. Pull it upward and let go. The string will snap against the ground, leaving a chalk line to follow when digging the trench.
Remove the dirt along the chalk line to the depth required by local rules. Periodically check the depth with a measuring tape to assure it is constant along the entire trench.
Fill the trench with two inches of gravel. Lay the PVC conduit in the trench. Shovel in six more inches of gravel.
Fill the trench with the dirt you removed when you dug it. Do not heavily tamp the back-filled trench, as this may damage the conduit.