I WANT my ISP to discriminate between low priority, high bandwidth sites (video) versus high priority interactive.
As an online gamer, I can sympathise with that position, but realistically, it is not going to happen. Given the approval to prioritise traffic, you know that the ISPs will do whatever they want that works out best for their bottom line.
For example, assume that Netflix caves and pays the ISPs for preferential traffic, which the ISPs have tried to bill them for, and which could happen. All of a sudden, their bandwidth hogging traffic has higher priority over your SSH. I doubt the 500 SSH using customers you mentioned could or would be willing to outpay Netflix.
On the other hand, you might take comfort in the many ads being delivered blistering fast to your screen.