Wait - you mean people who seek patents aren't "greedy people"? C'mon - that's the very bedrock principle of the patent system -
1. I invent something.
2. I win patent.
3. I hold exclusive rights to the use of the product for several years.
4. ????
5. Profit!
So I gotta disagree with you -
The patent trolls and the high frequency traders both exploit a system in a way that it was not designed for, i.e., hacking. They each are hurting people who are trying to use that system within the rules. Even if you do not like the system and the players, surely you can see that.