Turn off power to the electrical box.
Locate the outlet box in the floor of the attic. If the attic floor is uncovered, this isn't too hard. If the floor has boards on it, measure the location of the box relative to landmarks like the outside walls, and use a keyhole saw to cut out a piece of floorboard in the attic.
Put on work gloves and a dust mask.
Measure the open space around the box with a ruler. Measure from the outside edge of the box to the support holding the box in place. In an attic, the box is usually screwed into a joist.
Cut strips of insulation from a roll of batt insulation with a utility knife. Make the pieces slightly wider than the space you measured.
Stuff the strips of insulation into the gaps between the outlet box and the existing insulation. Replace the floorboards, if necessary. Restore the power.