This is Caislean Ui Bhriain, a three story tower house that I think the O Brien family built (maybe in the 1500s?). That was our big climb for the day.
The walls really make it difficult to move around in Ireland. We weren't looking to roam off the paths or anything, but you really need to pay attention to the map to make sure you get where you want to go. We almost went up a path to the right that looked like it was going towards the tower house, but actually went to the back of the island before looping over.