Just took a look down the action. If I line my eye up to look right down the raceway for the right lugs down to the extractor groove...it looks to be off slightly in the same direction? could be bias too as well now that I confirmed the sight was off.
I also think now that I have the front sight off that my pics, not being perfectly aligned and level, exaggerated the misalignment. I think/hope it will end up being off by about the width of the index marks. You bring up a good point with the alignment of the extractor groove that I hadn't considered yet. Guess we'll have to wait to find that out too!