People always accuse doctors of having a God complex, and in many ways the low fat paradigm is the result of that.
Ancel Keys made some observations and weak correlations about dietary fat and cholesterol being related to heart disease in the mid 1960s. This was fertile ground for researchers and clinicians and many of them staked their careers on it and due to the fact that they could never quite get their studies to prove the relationship between heart disease and dietary fat & cholesterol (and still haven't!) they were able to string this out into an entire career.
Once you have careers and reputations on the line, you have a self-sustaining paradigm -- nobody wants to come out after 30 years of being dedicated to this idea to say "Gee, we were wrong all along." So they never promote research that questions their beliefs -- and that's probably putting it mildly, they actively attack and discount it.
Despite nearly 40 years of this advice, though, obesity is skyrocketing and the low fat paradigm is starting to crumble.
I think there's another unspoken element in this, and that's an American cultural predisposition to promote paradigms which are judgmental and involve denial of pleasure. Certainly by the mid 1960s, overall economic success had made meat an everyday staple for most Americans. It tasted good and made you feel good -- so a solution to heart disease and obesity was penance -- don't eat what you enjoy and what makes you feel good. And if you don't get thin on low-fat? Why you're not trying hard enough -- not enough exercise, not enough self well, it's a weakness of character problem!
Part of why they reacted so severely to Atkins was that he never preached that -- he said "Hey, eat as much of that steak as you like! Put a tab of butter on it! Eat until you're full, don't go hungry!" This was like religious blasphemy, not only did it contradict the fact of low-fat proponents, it contradicted the morality of their position.