That statement is just as silly as if you said 'OH, well bullets kill, and are made of metal, maybe no one should use metal there either?!'
Yes, that's silly. Just as silly that because of the A-bomb they should not use nuclear powerplants, for exactly the same reasons.
I don't believe they should have huge petro based power plants that should something go amiss incinerate exceptionally large areas and make them un-livable well beyond your life span, causing slow deaths to large populations with birth defects years to come.
You know, the problem with oil-burning power plants (and in Japan that's what they are using to substitute the currently off-line nuclear power plants) that nothing has to "go amiss" for them to cause slow deaths and birth defects (and, I should add, currently there's nothing to suggest that the Fukushima incident will result in slow death or birth defects).