The problem is that the FAA (and other regulators around the world) have chosen to penalize the genuine hobbyist for the acts of the idiots. This is totally uncalled for and unfair. Imagine if, every time some dick-head decided to break the speed limit, *every* responsible driver was penalised as a result. That's the situation we have here with drones.
The regulators can't even define what a drone is accurately or consistently so instead of making even the smallest effort (such as differentiating between craft that have onboard GPS and an autonomous or semi-autonomous capability -- such as auto-land, return to home etc) they consider everything that flies without a pilot to be a drone.
This is just laziness on the part of regulators and gross unfairness towards the responsible members of a hobby that has for decades proven itself to be safe and family-friendly.
Ultimately, we have a bunch of suits who fly desks telling the rest of us (some like myself who've been flying model aircraft for over 50 years) under threat of severe fines and/or imprisonment, what's safe and what's not. Ludicrous!