| Subject | Datestamp | Replies | Score | |||
|---|---|---|---|---|---|---|
| new standard for robots.txt files - allow/disallow | ||||||
| attached to White House Website Limits Iraq-Related Crawling | ||||||
The first rule of intelligent tinkering is to save all the parts. -- Paul Erlich
| Subject | Datestamp | Replies | Score | |||
|---|---|---|---|---|---|---|
| new standard for robots.txt files - allow/disallow | ||||||
| attached to White House Website Limits Iraq-Related Crawling | ||||||
The first rule of intelligent tinkering is to save all the parts. -- Paul Erlich