This is a very reluctant bolt to remove...I can back it out but not remove it. The stock wiggles a bit but will not come out of the socket.
There is an extension on the receiver that protrudes into the stock. If the screw is completely loose, wrap a towel into a pad, place it on the pistol grip, and use light taps with a rubber mallet to loosen it.