You never have 50,000 death per year in the US to coal.
Perhaps 5 to 10 in the long time average due to mining accidents. I really doubt the total number of workers mining coal is close to that number.
As you surely know, coal plants are huge polluters and pollution causes health issues, which in turn add up to early deaths, even if we ignore damage done to environment.
But then again, opposing nuclear power is not really about protecting humans or nature, now is it? It has long since turned into politics, where opposition is based more on identity than rational calculation of risks and rewards of various options. And who knows, perhaps being hit by the double-whammy of full-power climate change and energy crisis simultaneously will finally teach humanity to not treat important decisions as tribal identifiers. It's something we must learn before we venture beyond this planet, since the cost of irrational stupidity will continue getting higher. But I fear the lesson will be exremely painful, even by the scale of these things.
And: fix your damn mining safety issues instead of blaming it to 'coal', mining of uranium is only marginally more safe.
Thousandfold decrease in mining causes a thousandfold decrease in mining-related deaths, even before factoring in such details as coal being highly flammable and uranium being not. Also, unlike coal, uranium can be extracted from seawater, so with it we could theoretically eliminate mining altogether.