I see it another way. If you have a RC drone then chances are you won't let it out of your sight because if you can't see it you can't control it. So you are naturally more cautious about where you fly it, how you fly it and to what distance you allow it to fly.
Conversely these "set it and forget it" drones can be programmed to fly miles. You set a course, off it goes and you'll see it again 20 minutes later. Assuming it hasn't hit a tree, power / cable line, or a bird, or a plane, or been flipped by the weather, or simply suffered a fault and fallen out of the sky. The drone is also likely to be programmed to fly over points of interest which may be roads, buildings, cities etc.
That's where the danger lies. The risk for the operator has disappeared and a laissez faire attitude which could put other people at greater harm.