It has been a military base since the 17th century and is currently owned by Historic Scotland