Robert I of Scotland is known for his his defence against the English, but few know about his attack on many Scottish castles to return them to his control. This included Inverness which was burnt to the ground on his journey to the Battle of Bannockburn in 1314.

After Bruce had destroyed the castle which stood in Inverness a stone replacement was built. The exact date is not known, but it is thought to have been during early 15th Century.