It doesn't bring in the tourist numbers like the more famous Welsh castles but it's a crucial piece of our history