How did you end up getting the front sight base off?

I tried mine tonight... got the 4 screws that hold the sight hood on... then took off the sight blade and screw... then tapped the pin out of the base...

Now it's stuck... I tried tapping (hammering) the front sight base off using a block of wood as a punch... but that thing is not budging... any thoughts?

EB