UAS pilots are not idiots, if I hear a low flying manned aircraft I immediately dive to the ground. It is not like a stupid bird.
You may very well not be an idiot, you might operate your drone with intelligence and common sense and are aware of how to fly your UAS safely. If so good for you, way to set the example!
But the problem is not you, it is those idiots that do not think about the consequences of their actions that is making your hobby look like shit. Like the moron that flew his drone into a fire zone causing the fire fighters to ground their flights. Or another idiot that dropped his drone onto a kid at a movie theater. Or that one genius that crashed his drone on the white house lawn. These guys are the problem and who are getting everyone so riled up about drones.
So I want you to do yourself and every other responsible drone operator a favor: If you are out flying with your buddies and you see or hear about them about to do something stupid, go over there, grab them by the shirt, and slap the fucking taste out of their mouth. Because they are doing more harm to your hobby than a thousand regulatory busybodies ever could.