Actually, Columbia University was originally located near Wall St and Broadway. It moved up to Midtown for more space, then in the early 20th century it moved to it's present location in the Upper West Side/Harlem/Morningside Heights area. I think Columbia would be the exception in your list. Another fun fact is that it that Columbia University is the second biggest land owner in New York City, behind the Catholic church.