That's not totally true. Just look at blacks in the US. While they were primary located in the southeastern states at first, there were several waves of mass migration. That's how we ended up with major cities like Detroit, Cleveland, Chicago and Washington D.C. that have black majorities.
They moved to get away from the KKK and segregated bathrooms. Are you suggesting that solution is somehow applicable now? Start a KKK against people who didn't go to college so they will move?