Even though hard economic times were already foreshadowing the Great Depression in Southwest Georgia, Brinson was still a thriving farm community in the early 1920s, when this typical Colonial Revival schoolhouse was built. It has been identified as the Brinson Consolidated School, and was probably an elementary school. Consolidation was not a concept static to just one decade, and counties often saw the value and thrift of consolidating small rural schools into a central location.

According to a 1998 Georgia Historic Preservation Division resource survey, the school was once a much larger H-form structure and apparently this wing was all that survived a fire [date undocumented]. The form also noted that Gordon Bower was the superintendent of Decatur County schools at the time. In 1969, the Brinson school was sold to a group of parents for the establishment of a private school and was home for many years to Oaks Academy.