I have no doubt that there is a correct amount of upward pressure and I will revisit it and do some shimming to find the correct pressure for my rifle.
I shot it before doing anything to it at all, it was after I removed the wood at the muzzle did the accuracy dramatically improve, perhaps there was too much upward muzzle bearing.
There is still a bit of pressure, just not the upward 45 lbs or so it had, there was also some wood warping causing pressure on one side of the wood as well.
I am going to place two targets side by side at 50 yds and try 10 rounds off the bench as it is, then I am going to add a small shim under the muzzle that will be close to 5 lb and shoot another 10 rounds.