You should be able to drift a sight without all that problem. A drift and a machinist's hammer, or make a sight cramp out of steel...that's a bit of an imagination job though.

Go through the...