Gothic design was all the rage in Vienna in the first decade of the 20th century, at least on Church Street. This beautiful structure, as well as the Methodist church just a couple of blocks away, are two of Vienna’s most architecturally significant houses of worship. This congregation was organized in 1836 as Providence Baptist Church and renamed First Baptist Church of Vienna in 1890.