Ah, so "right" and "wrong" can be determined by popular vote now?
Not so much "popular" as "fiscally responsible".
Society has a compelling interest in keeping people employed as long as possible - Ideally until they drop dead on the job, but as long as possible in any case. The longer someone can't work, the longer society will bear the financial burden to keep them alive. A decade of SSI, we can readily bear when offset by a 40 year career of paying in to that system. 30+ years of welfare because companies "don't want" to hire competent experienced professionals, however? The numbers just don't work out when we allow that to happen on any large scale.
So yes, we as a society have determined, for our own good, that companies (you remember "companies", right? Legal fictions allowed to exist as a boon society grants them in exchange for the small possibility they will benefit us overall?) cannot turn away otherwise-qualified people because of a few protected categories.
It doesn't matter if you don't want to work with blacks - Too fucking bad.
It doesn't matter if you don't want to work with women - Too fucking bad.
It doesn't matter if you don't want to work with fogeys - Too fucking bad.
It doesn't matter if you don't want to work with Jews - Too fucking bad.
If someone can do the job and you don't "want" to work with them, rejecting them for only that reason breaks the law. They have a "right" to consideration for employment regardless of the age, gender, race, or religion; you don't have a "right" to run a company however you want, simple as that.