A side building used as a powder magazine got dilapidated rather quickly when it exploded two years after his death under mysterious circumstances. I was out there a few years back, and the remaining main "castle" walls had been shored up by metal trusses. The little house on the top of the hill is still pretty much intact, and is used as a gift shop.