Comment Re:Robots.txt (Score 1) 234
The Internet Archive says that it subscribes to the The Oakland Archive Policy which for |requests by governments" says:
Archivists will exercise best-efforts compliance with applicable court orders Beyond that, as noted in the Library Bill of Rights, 'Libraries should challenge censorship in the fulfillment of their responsibility to provide information and enlightenment.'
Seems like this may just have slipped past them. Let's make sure they know they need to sort it out... Surely they only removed it from the Wayback Machine, not from the archive itself.
That's actually a really good point. I wonder if there's any justification in the Policy for retroactively removing content based on current robots.txt