The Taunton Public Library came into existence through City Council Ordinance on March 21, 1866. The actual structure was not built until 1902, when philanthropist Andrew Carnegie donated $60,000 to the city for the erection of a Carnege free public library building. The cornerstone was laid on September 10, 1903, and the library was completed in November 1904.

Designed by Albert R. Ross and constructed of Indiana limestone, the library is an example of the early 20th century Beaux-Arts style. The facade includes Scamozzi columns and pilasters, with a formal stone sculpture just above the main entrance. Also carved into the facade is the original inscription bibliotheca fons ervditionis, or the library is the fountain of knowledge.