You said you were 100% legit (even though you were not). It seems like minimal inconvenience for having the license. You knew inspection was possible when you applied.

I'm sure no one welcomes the ATF or any other fed or local LEO into their home, but I can't imagine getting that upset by a routine check.

Seems like more a PIA than anything else.