What is needed is network transparency, not necessarily network neutrality. EG, under some definitions of network neutrality, various useful traffic shaping (such as placing heavy users in a different QOS tier when compared with light users, implementing per-user fairness, or doing Remote Active Queue Management to mitigate the effect of overbuffered access devices), would not be allowed.
I agree with you, and so does everyone else. You have just defined net neutrality. Net neutrality never, ever, ever considered stopping traffic shaping for heavy bandwidth usage or QoS. That was just a straw man set up by neutrality opponents to knock down. It's not your fault, since they scream it at every opportunity.
Net neutrality's ONLY definition is the prohibition of traffic shaping based on source or destination IPs. QoS has been a part of network design for decades. Torrent filtering is another argument entirely. It's not just the naive who have been misled: you've obviously done your homework and thought about the effects. The people arguing against net neutrality (aka: people who want to sell you an Internet Package with Yahoo and Google, or the Advanced package with Blogger and Hulu) are crafty and have no compunction about lying.
Have no fear, kind sir: you are a supporter of Net Neutrality, and have correctly identified, in its entirety, the misleading crap lumped in with it by its detractors.