Comment Re:New robots.txt file (Score 0) 143
Yes, but all the lines in that robot.txt file point to text-only versions of other pages, presumably so the same content doesn't get indexed twice.
Failure is more frequently from want of energy than want of capital.