It's not that atheists are childishly attacking other points of view (as most on the receiving side like to characterize it)
They're attacking backwards and terribly counterproductive systems of thought. While a lot of people can be remarkably pragmatic when it comes to dealing with the world while carrying the baggage of religious faith (by following evidence-based reasoning most places and walling off their faith off to the side, even if they think it's their guiding light), it's not a good thing... as they still have big ass blind spots that screw stuff up. Worse, way too many people wrap their entire view of the world around faith, and don't ask for explanations because that's not how faith works.
Lots of people that don't think they're "smart enough" for math or science are just being poorly educated. If you place the things you see in the world into a big contextual web of whys and hows... then it'll be much more obvious why stuff works. A great deal of what makes a person appear "smart" is an ability to correctly put things in context and extrapolate uses and purposes from that. It's not magic, it's having a functional base of knowledge to draw from.
Faith puts "bad data" in the contextual web and prevents good contextual analysis of what you see day to day. It's very counterproductive.
The world needs to solve problems by looking at evidence and choosing what best fits the presented facts through reason. Faith massively interferes with that process. (massive inequity, climate change, the middle east, gay rights, anti-vaxxers, etc)
If your atheist and yet somehow don't understand the immense benefits to evidence-based reasoning and just go off some kind of faith of your own... then yeah your an idiot. That's almost never what's going on with your run-of-the-mill atheist... but I understand why someone who chooses faith would think so.
I'm not even "hardcore athiest", as many would define it as I'll accept anything beyond what is reasonably well known is just that... unknown. However, I don't know a single religion that doesn't have major conflicts with where our knowledge is at in the present, so they're broken. I also don't make up stories to explain the unknowable, or give the unknown any kind of magical aura. It's just not known yet, get over it.
Faith-based reasoning is the problem that's being attacked. Not "just some other point of view".