They were quite a bunch, eh? Fun times, if you were on the winning side!
The big difference seems to be that the northerners raped, pillaged, burned, then settled down and became reasonably good neighbors. The easterners (and by extension, the Normans) raped, pillaged, burned, and set themselves up as overlords.
Alas, the castle isn't really in habitable condition, even were I a rich lunatic willing and able to cough up the back taxes. Not irreparable, per the photos I've seen, but rather a ways from a turnkey estate.