Baxters are found all across Scotland but those in the west are generally regarded as dependents of the Clan MacMillan. In Fife, they were a prominent family in their own right and witnessed important documents in the 13th century. Between 1200 and 1240 a Reginald Baxtar witnessed a gift of a church of Wemyss in Fife. The name is still found frequently in Fife and the Baxters of Earlshall in northern Fife lived in a baronial castle there. Kilmaron Castle was a mansion built for a Baxter family near Cupar in Fife, around 1820.
In 1296 Geffrei le Baxtere of Lossithe in Forfar took an oath of allegiance to the king. Baxter was (and is) a common name in Angus as Forfar was at one time a royal residence.