Place a ladder against the side of your home, making sure that it is tall enough so that you can not only reach the icicles, but can see the gutters or roof. Do not place the ladder against the gutters, as they can become weakened by icicles or other elements over time and might not be stable.
Put on heavy-duty gloves so that your hands are protected when you handle the icicles. Use an ice pick to chip away at the icicles. Pull off the icicles and the rest of the accumulated ice.
Use a small spade or your hands to remove any other debris that is clogging the gutters. This could be leaves, pine straw, twigs or any other type of vegetation. The vegetation can help icicles grow as they impede the water from running out of the gutters.