Comment Re:Dumb crawlers require dumb solutions (Score 3, Interesting) 43
671671
That was one morning for me. Within 8 hours 600k+ unique IPs requesting a single page, all with quite old browser user agents. A sample of them all returned them as domestic ISP IPs from various regions in the world. So they were probably doorbells, TV, nanny cams, fridges, and other compromised IoT devices.
The problem from China got so large that I simply added a netset file for China to my firewall. I figured I'd help their great firewall as my site doesn't really get legitimate users from China.