Inspect the pothole for any debris or leaves that may have fallen into it. Remove as much of this material as you can from the hole.
Dig the hole a little deeper with your shovel. Pat the excess dirt onto the walls of the pothole.
Fill the hole with dirt so that the soil sits 3 or 4 inches above the surface of the driveway.
Spray the area with water from your garden hose and compress it with a hand tamper. Rake the area until it is flush with the rest of the driveway.