Pretty cool, you need to fully excavate your backyard. Watch out for unexploded ordnance, LOL. You're only scratching the surface gardening.
I don't remember finding anything interesting at my house. I've found things at clients houses on occassion and they usually let me keep them. Indian Head penny, very old toy car and a rusty license plate from the 1930's are the top three.