The Rummelhardt School Section 9 was organized on October 25, 1843.  The one and one quarter acre site was bought from David Eby for five shillings.  The purchase deed was issued to George Clemens, Hugh R. Folson, Joseph Erb, Jacob Lutz, Elias Bowman, Henry Snider, and Elias Snider.  These men were known as the Common School Commissioners of the Township of Waterloo. 

In 1947, a brick addition was added that included several classrooms, a hall and new entrance and the washrooms were moved inside.  The stone projection on the Erb Street side of the building was originally the teacher's room.

In 1964, the school, which was then part of Waterloo Township School Area 2, ceased to be used.  It was the second oldest school among six in the area, (Martin's was the oldest and the other schools were Elmdale, Erbsville, Lexington and Bearingers).  This school building is the only remaining stone school building in the City of Waterloo.  The building has been used continuously since 1843 as a school.  The K-W Bilingual School purchased the building in 1966 from the Township of Waterloo, and has operated since that time in this location.

The Rummelhardt School is a single storey building designed as a single room school house with a teacher's room attached.  The building is constructed of split granite fieldstone laid in somewhat regular course with a fair bit of mortar to hold the stones together.  The walls are approximately two feet thick.  A number of additions have been added to the building in the past, however the main structure has remained in its original configuration and is a striking example of an original stone school building.