Located near the summit of Fort Mountain, the rock wall which gives the mountain its name remains a mystery. Its origin has been attributed to everyone from Hernando de Soto to the Cherokee. The de Soto connection has long been disproved but the specific use by the Cherokee is still being researched. Some believe it was ceremonial while others consider it territorial.

A marker here reads: This ancient stone fortification, 885 feet in length, and the land on the crest of this mountain, 2832 feet above sea level, was given to the State of Georgia for the establishment of Fort Mountain State Park by Ivan Allen, Public Spirited Citizen of Georgia in the year 1934.