The front sight blade SHOULD be merely dovetailed and held by the interference fit. Could be staked in place additionally, but that ought not defeat a larger hammer. (Make sure the base is well supported before impacting the sight at it's bottom at the dovetail area. The assembly may just need a bit of extra force to get moving for the first time in 50-60 years! Once movement has started it ought not take as much force.
I DO recommend using a larger hammer. High velocity blows from a too small hammer will likely peen the metal in a localized area rather than merely causing the sight to move.