In 1893 a library was opened in the Y.M.C.A. building. Not much interest was shown and with the closing of the Y.M.C.A., there was no library for seven years. The Altruistic Club was organized and began a library service in 1902 in a building that was occupied by an auto shop/garage. This was also located in downtown Marion. A flood in 1904 almost ruined the little library so it was moved to the basement of the Marion County Courthouse. A Library Association was formed in 1904 with annual dues of $1.00 per family. Only those families who paid the annual dues could use the facility.

A $100 donation was given by the Priscilla Club to the Library Association in 1911, which started other local clubs to donate funds to maintain the library. In 1916, a petition was introduced to the City of Marion officials to allow the library to become a part of the city. The library continued its operations from the Courthouse basement until May of 1918, when a room was rented over what was then a pool hall in downtown Marion. It remained there until May1, 1922, when it moved to a building, which is now the Marion County Record newspaper office located across from the courthouse.