most people doing "Agile" aren't really doing Agile......they're doing more of an iterative-waterfall with the overhead of certain Agile processes.
I always hear this from Agile proponents, and maybe it's true. All I know is that I've worked at four places that use Agile (three of them had been using it for a long enough time that they aren't new at it), and in all four of those it has made development a living hell, delayed production, and reduced the quality of the end product. It amplifies the fear factor, not reduces it.
The place I work for now is in the process of adopting Agile, and so far it's going about as well as I've experienced before. In fact, it's inspired me to move on to a different company.