Sweetwater is located adjacent to Refuge Primitive Baptist Church. The South Georgia Conference of the United Methodist Church notes: Less than a mile from the present site, this church was organized in 1888, in a log church with 10-12 members.  It takes its name from the nearby Sweet Water Creek which runs just north of the church.  This is the original church, brick-veneered with new windows and air conditioning added in 1979-80.  The original hard carved altar rail and pulpit are still used.  It had door on each end and both sides with Rev. H. T. Ethridge as the first pastor.