Remove it with a small stone, file, etc. and hope for the best?
For what this rifle's serviceable life left is, that's what I would do. You can't really screw it up, unless the new shiny spot is going to bug you; and it might make a noticeable difference in the accuracy.
If this was a precision rifle thusly damaged, I would have the entire crown redressed in the lathe.
Cet it re-crowned so that the plug bore gauge runs freely. That's what we would do. Then accuracy test it according to the EMER. THAT is the final arbiter of a barrels condition
Rifle in question is really a BSA No4, it just so happens to be a T. Rifle matches itself but the No32 Mk1 scope (serviced some years back by Peter) and bracket while real, are not originally from this rifle.
I might have another reason for lack of accuracy besides the crown. The at least twice staked in service front pad screws loosened up again and the front pad came loose from the receiver so I actually have two issues I need to fix.
The current sorry state of "gunsmithing" in my local area is pretty dire unless you need the sights changed on a Glock or an AR-15. I'm not sure the few I know of even own a lathe or have a backlog I'd grow old waiting for them to burn down to get to my small crown problem.
So with that in mind, I have not issues buying some tooling and getting after it myself IF I'm not wasting my time and money or creating new issues. They are out of stock at the moment, but I'd think something of this nature (but maybe not this specific item) would potentially address my crown issue: BROWNELLS 45\ Cutter Steel Pilot Fits .311 Muzzle SKU: 080587311