Might be a problem with range adjustment?
In this case, I guess that if it's not enormous, then it should not be very problematic.
My reloads already don't match the range on the rear sight.
From the collectors point of view it might be a terrible thing to do, but I'd keep the original sight anyway.
It's just that the only thing that really bothers me in all those bolt-action rifles is the adjustment of the sights.
Elevation is mostly ok, but the drift is always a pain right where the sun never shines.