Your statement makes sense right up until someone flies one of these into the engine of a commercial jet and causes a crash that kills hundreds and does millions in property damage.
Drones need to be regulated. The FAA is throwing a harsh line right now while they work out the regulations because if they don't the courts will hold them to that relaxed line they took while writing the regulations. I have no doubt in the end we'll end up with generally sensible regulations but it's going to take a while.
When drones were $5000 a maybe a dozen people in the entire US owned one it wasn't a big deal, but when they start selling for $200 a Costco they are going to become very very common and a threat to aviation. The FAA is taking action precisely because they've had several close calls with airliners. In starting the regulatory process they start with the heavy fist and then loosen it based on the input they receive and the research they do. They are likely going to require people using them for commercial reasons to have some license where the person has committed to not put drones into the commercial or military flight corridors and to generally stay away from sensitive sites (reactors, military bases, etc). And the non-commercial users are going to be restricted in height ordered to stay away from airports and flight corridors, they could even make it like RC planes where they have to use FAA designated sites and they are banned outside those areas.
People don't generally realize how dangerous these things are. A 10 pound drone that lost power at 300 feet would kill someone on the ground if it hit them and would do immense property damage (it could punch through a roof, heavily damage a car, etc). The more drones in the sky the bigger the chances of this type of incident. Drones are one of those areas where your right to fly one could harm my rights and it deserves to be regulated to prevent discord, property damage or injury to people.
I don't disagree that making someone have a pilots license is stupid, but right now that's the only license the FAA basically has for piloting anything. I would support requiring that people piloting drones have taken and passed a safety course and in the case of commercial drones have insurance.