From good stock then Bob, either Templar or Viking
Two brothers came back to East Anglia from the Crusades and were appointed to be sheriffs. Between that and an ancestor being hoodwinked into signing into the Doomsday Book, those are the first mentions we can find.
Bob
"It is said, 'Go not to the elves for counsel for they will say both no and yes.' "
Frodo Baggins to Gildor Inglorion, The Fellowship of the Ring