Lay a tarp under the work area to catch bits of mortar and stone than will fall. Put on eye protection to deflect bits of mortar that may become dislodged at high speeds.
Start at the top left section of the stone veneer wall. Place a chisel on the mortar between the stone and the cinder block. Hit the end with the hammer, driving the chisel into the mortar.
Move the chisel a few inches to one side and hit it again. Work your way around the first stone, angling the chisel away from the cinder block.
Pry the stone from the crumbling mortar with the chisel or a pry bar. Once the stone is out, chisel away any remaining mortar pieces.
Move to the next stone on the top of the wall and start chiseling it out. Work across the top and move down, row by row, until you reach the bottom.
Clean off any remaining mortar with the hammer and chisel once all of the stones have been removed. Avoid damaging the cinder block with the chisel.