In 1949 a new school opened on the property that is now known as Inverness Middle School. The name of the 1949 school was Inverness School, but in 1950 the name was changed to Booker T. Washington School. Inverness School and Booker T. Washington School were segregated schools for black students and had classes for students in grades one through twelve. The school facility in 1949 consisted of four portable buildings and one permanent restroom building. The four portable buildings came from four different locations and were heated by pot-bellied stoves. One building came from Floral City and was used as the cafeteria and band room. The building to the south of the Floral City Building came form Dunnellon. The Dunnellon Building was the largest building on the school property. It was used for assemblies, classrooms, and on special occasions for parties and proms.

The sports and physical education programs have expanded so that a students are trained and given the opportunity to use their abilities in a sport of their interest. During the 1969 - 1970 school year, there was only one school team, and that was a football team. In 1999 the school was represented by a football team, the boys’ seventh and eight grade basketball teams, the girls’ seventh and eighth grade basketball teams, the boys’ and girls’ track teams, the boys’ and girls’ tennis team, the girls’ seventh and eighth grade volleyball team, the boys’ and girls’ golf teams, the boys’ and girls’ tennis teams, and cheerleading.