Located on the courthouse square, this gabled-ell building served as the town library for many years. Thanks to Andrew Carey for the identification. I’m unsure of its present use.
Mount Vernon Library
Vanishing Georgia: Photographs by Brian Brown
Since 2008. A visual survey of Georgia's historic architecture and culture. 8,000 locations. 27,000 images.
Vanishing Georgia: Photographs by Brian Brown 
This was the library. I spent a lot of time there.