You can also see the keystone in the front of the church with the date 1864. This is probably from the last rebuilding that proceeded the 1884 fire.
Present day church utilized the existing walls.

Present day church, similar view. (looking down State Street, toward business district)