Fine steel wool and oil is all you should need for the metal. It doesn't look that bad. It shouldn't affect the finish at all and will get the surface rust off.
Japanese rifles do not have BLO, they used a finish type native to Japan, should be some good posts on here about them. Hard to duplicate and as the plants used have similar properties to poison ivy, they can be a skin irritant as well.