On January 6, 1857, a small group of believers met to organize "a regular place of worship." After a discussion of whether they would organize as Presbyterian or Congregational, they elected to become a Presbyterian congregation. The Rev. Mr. S.H. Barten preached a prepartory lecture and administered the first Lord's Supper on the first Sabbath in February 1857. After several years of soliciting money, a resolution approving the building of a building was passed on March 28, 1863. Construction began in 1863 and was completed in 1865, being interrupted by a departure of the men for the Union Army during the Civil War. That building is still in use as the sanctuary, though a full basement has been added, as well as two additions for classrooms and offices. Constructed of sturdy Wisconsin pine and oak, it is a typical New England church, double cube, Classic Revival, which was designated as an historical landmark by the State Historical Society in 1987, and in 1980 entered into the National Register of Historic Sites by the Department of Interior, Washington, D.C.

During the early years, there were a series of pastors, student pastors, and pulpit supply pastors. In order to share the cost of a pastor, Pardeeville formed a union with the Rosedale Presbyterian Church. The two churches shared the services of one pastor and the cost of the manse until 1999, when the union was dissolved by mutual agreement of the two sessions.

In August of 1991, the thriving church was rocked by the announcement that the Session had voted to request transfer from the Presbyterian Church (USA) to another denomination. The vote was not unanimous; the result was that the church was split. A hardy group struggled to keep the church alive. Current membership is 77.

Currently, the church is sending designated funds to support Dan and Carol Adams in Korea. We are also sending funds to Compassion International to support a child in Kenya. First Church also has good relations with the other churches in the Pardeeville area, working together through the ministerial association. In 2000, joint worship services were held on Sunday evenings during Lent, a joint community Vacation Bible School was held, and a community concert was sponsored.