>"Today, git.kernel.org receives about 6M daily requests demanding to see random commits. Of these, 66% are still immediately batted away with the Anubis challenge, but 33% are now solving the math and getting through to the main site â" because apparently what we have to offer is worth spending a ton of cycles to calculate the Anubis challenge... With a bunch of generous assumptions, legitimate requests are only about 2% of git.kernel.org traffic â" everything else are scrapers..."
I would love to calculate just how much electricity and other resources are being wasted on AI crawlers solving useless challenges and scraping useless duplicate data. And in the process, raising electric rates and making RAM and storage unaffordable for millions of users and businesses.
Oh, and also in the process of this "war", legit human users are now being "automatically" misidentified as bots and locked completely out of web sites with zero recourse. And you thought that CAPTCHAs were bad...
"Edgesuite" by Akamai is an apparently one of these poor netizens performing a "protection service" that is flagging Firefox and/or other browsers under Linux on some of their "protected" sites as bots and banning access. Go there and all you will get after certain pages or searches is a cryptic error message like:
Access Denied
Reference #18.8b551702.1787659556.715cd97
https://errors.edgesuite.net/1... ... 56.715cd97
Of course, the link has zero info as well. And there is no way to get whitelisted or request help from Akamai. If you can find any info on their site, it is just to claim they can't do anything and direct you to contact the admin of the site affected. The web sites that enroll in this crap have little to no control, have no idea they are blocking legit people, and will not help users either (they are not set up to do so).
At work, we are now unable to use homedepot.com and lowes.com (with any browser under Linux, which all of ours are, of course) for this exact reason. And no, our IP address is not listed in any of their blacklists as poor reputation. Interestingly, I have no issue with those websites when at home, under Linux/Firefox. So it could be IP address, or version of Firefox or whatever browser, or what screen size you might have, or how many requests come from one IP address (not like we visit either of those sites often), or any other number of super-secret criteria. Utterly infuriating.