and left middle-east affairs completely, would ISIS/Al-Qaeda/Taliban call off their aggression?
Not the same things and can't be treated the same way. Thinking that you can just lump everything together and treat them all the same is how you get into these kinds of situations.
But to your point, no, you can't just leave them alone at this point. We created (or at the very least contributed to) a situation through our actions and it is where we are now. The world is not black and white though. Everything is not on or off. There are varying degrees to things. Do we just pull out of the middle east completely? No, we made a royal mess of it and pulling out completely at this point is only going to make it worse if such a thing is possible. But we can start doing some sensible things like stopping the drone strikes. I know, we need to act when we think we have a guy in our sights and blah blah blah...that's not how a nation of laws acts. We don't assassinate people and we don't fire missiles into civilian areas. There is no justification for it. Are we really that scared of some guy sitting in a mud hut in the middle of the desert on the other side of the world? If we really think that the guy is engaged in criminal activity, then put him on trial. There is no excuse for blowing up his neighborhood because he might be mad at us and mean us harm.
It is time for us to get on the ball and stop acting like scared little children. We've been using a hammer to work on a problem that isn't a nail. It's past time to stop wildly swinging and beating the shit out of everything in reach because no matter how many times we swing it, we can't hammer two pieces of paper together.
Look up their policies on women, religious tolerance, and free speech for more info. But hey, I guess we're supposed to tolerate intolerance.
We tolerate it in this country, so why should we care about it in other countries? More to the point, this country was founded (at least partly) on freedom from being told what to say, do, and think. So who are we to go into someone else's country and tell them what to say, do, and think? Yeah, the entire middle east is socially behind the 1st and 2nd world by at least 100 years (as is most of christian Africa). Sending our troops over and making them play nice with each other isn't going to suddenly make their society advance 100 years in a couple of months.