You are painting with broad strokes. By the same measure one could argue that guns have pretty much one use: Accelerating bullets. The kinds of targets the bullets can be accelerated towards are varied, one of which is murder victims. There is considerable societal interest in regulating guns' use in bullet acceleration leading to the production of murder victims.
You conflated all chemical reactions with bomb making, which does not make much sense, just like my conflation of all gun use with murder doesn't.
Also, by your logic, hydrocarbon fuels should be severely restricted because they can be used to make ANFO. Also vegetable oil because you can use that for ANFO, too. Or you leave the ammonium nitrate away and just build a fuel-air bomb. Society has interest in regulating the production of those, too. And let's not forget that electricity can be used to electrolyze water into hydrogen and oxygen, which can also be used as an explosive. Access to electricity should be regulated as well.
Or we agree that just because something can potentially be used for actions that are against the interests of society we can't assume that this is a particularly common use.