Comment Re:They got my email (Score 1) 268
How is a website supposed to know the difference between a visitor and a crawler? Both send HTTP requests for pages. Crawlers could use special user agent strings, but they don't have to. The only way to keep automated systems off of a website is to use a CAPTCHA, which tends to be annoying to legitimate users, and therefore used sparingly.