Use a slightly smaller punch so you can angle it to touch the inside of the tube, slide it down until it contacts the top edge of the writing tip unit and give it a few gentle taps, turn the pen and repeat on the other side of the barrel. Continue turning and tapping until the tip is free. See drawing:

Scan_20140820 by walter.hall, on Flickr