Thanks to Deborah Brantley for the identification. Guy Singletary also notes that it closed about four years ago and that some of the members now attend Wrightsville United Methodist Church. Many thanks to David Frey, whose wife Deanne once attended this church, for the following interior shots he made in 2012.
Vanishing Georgia: Photographs by Brian Brown 
Has the two entrances in the front, so it must be quite old