Plan to cut the tree in spring or summer, never in fall or winter. Pruning the olive tree in spring or summer will prevent cut branches from being exposed to dangerous, cold conditions.
Look at the olive tree, examining it from all sides. Identify the lead branches of the tree. Lead branches are where growth should be focused.
Use pruning shears to remove sucker branches around the lower trunk of the tree, then from the lead branches. Trim away sucker branches from the main branches to make the tree look cleaner and allow a smoother circulation of air and sunlight. Use a hacksaw to cut away thicker branches.
Select four or five lateral shoots to prune back. Prune back lateral shoots to encourage fruit production. Clip the shoots back 3 to 4 inches.
Cut away any obviously dead or hanging branches. Make the cuts near the trunk of the tree.