It's best not to remove the finish unless you plan on refinishing the rifle.
Always sad to see fine rifles with decent metal ruined by some _________ who stripped a century of patina off the woodwork and left it looking like piece of antique furniture some _______ used paint stripper on.