Yes, sanding or polishing off a bit of the finish will make the beveled end of the pin a bit more visible.

Lightly center-punching the left-end of the pin will help prevent the Drive-Punch from slipping.

This will allow more force to be directed in a straight line. (You can even 'drill' slightly into the end of the pin, so your Punch is easily controlled).