Holton Hall, a residence hall, was built in 1899. The hall is named in honor of Edward D. Holton, who served on the Board of Trustees for Milwaukee College from 1853-1872. Holton was one of the organizers of the first railway in Wisconsin and served on the Wisconsin State Legislature. Holton Hall continued to be used by the University of Wisconsin-Milwaukee when the university purchased the property of Milwaukee-Downer College in 1964. The building today is used for classes and faculty offices.