You can do what you like on private property, but you can't control public roads. If the unexpected happens, the best possible outcome is ensured by travelling at slower speeds and maintaining maximum vehicle control, regardless of your baseline skill.
What happens if you're busy hooning around on your "empty" road and the "unexpected happens"? You'll be just as likely to have an accident as all the other "sheep", because you're closer to your own limits. I've lived in areas with lots of "empty" roads (think driving 10km without seeing another car), and most of the bad drivers in that area weren't honing their skills; they just drove badly. There were plenty of accidents; a surprisingly large number given the local population. You think they were caused by people travelling at the speed limit and taking the turns like a snail? Me neither...