St. Paul's Episcopal Church was erected in 1834. The parish moved to a new building in 1866. The new brick structure was constructed just to the north on St. Pauls Avenue.