That is the bolt stop. The "peg" protrudes through the receiver rail and catches a corresponding detent in the left lug of the bolt. If the rifle is pointed down, this should hold the bolt back for reloading.

The bolt stop and detent in the bolt were done away with during Rem '03 production, I believe.