According to the South Georgia Conference of the United Methodist Church, this congregation dates to circa 1814. [The church site lists it as Horse Stomp, not Horse Stamp, but all modern maps and the church signs themselves use Stamp]. Either is among Georgia’s most interesting place names. First established at a location used as a headquarters during the War of 1812, the name is said to originate from the clearing created by horses ‘stomping’ vegetation. The first house of worship was built of logs and several frame structures followed. The present structure dates to 1926.