Comment Re:Can someone explain to me... (Score 1) 72
I'd argue that if the data is used for AI learning, there is no need for it to be more than a couple weeks old. I'd also argue that given the general shitification of Wikipedia, images 10 years old would be more useful than the current data. Alternately, with some programming work, the crawler could look at the Wikipedia page change log and only download pages changed since the last crawl. This would work real time or locally updating from a new image.
But then what do I know. I'm just a cynical old fart used to programming in assembly language.