Comment Re:New robots.txt file (Score 0) 143
Yes, but all the lines in that robot.txt file point to text-only versions of other pages, presumably so the same content doesn't get indexed twice.
If it has syntax, it isn't user friendly.