One survey states that this church building dates to 1896, but the congregation may be older.
There is a very large cemetery adjacent to the church. A modern structure across the highway now serves the congregation.
Union Primitive Baptist Church, 1896, Madison County
Vanishing Georgia: Photographs by Brian Brown 
This building belonged to the Union Baptist Primitive Congregation , and is totally separate from the Union Baptist Church ( that is currently across the road ) that was established in 1848, and is part of the Southern Baptist denomination . Several years ago the last surviving member of the primitive congregation gave the deed to the Madison Co. Historical group, and they have tried to stabilize the building .
Thanks for the information. I will update accordingly.
beautiful shots