Interesting. I used the Scotch Brite because I didn't want to abrade the wood and fine sandpaper would simply clog and besides, one cannot 'raise' sanded wood with a damp cloth once it's been oiled. The Scotch Brite worked just fine. Perhaps it was more appropriately applied to linseed oiled wood as I did. I kinda think I used 'used' pads and not fresh for the very reason you mention. I may have tried used ones first then moved on to fresh - can't say for sure now. However, it is less abrasive than steel wool.

I assume everyone knows about 'raising' wood during the final fine sanding/sheaning stages. The damp cloth application to 'raise' the fibres for the next sanding until the wood stays smooth.

Can one get stainless steel wool? Or fine enough brass wool? That would solve the lost whisker problem. But I still suggest Scotch Brite (there are different grades of Scotch Brite).