Comment Behind that bot are legitimate users! (Score 1) 78
I just planned a holiday with MCP servers. It was legitimately massively better than calculating everything manually, and I'm normally OK planning holidays, but this assistance just helped me do everything to a much higher quality.
If too many bots are hitting your website, then shut it down and open an MCP server. I had to use an obscure Japanese service to get the coverage I needed.
This is a massive opportunity.
In other areas, all of the hobby websites I've used for decades are closing public access and going subscription only. This is incredibly frustrating. Before we only had sites like Facebook and Myspace being anti social. Now it's justifiable to wall off any site!
So what I'm having to do is to
pay for a subscription, manually scrape to break the data silo to get the data back in my hand because
interoperability is breaking down everywhere!
Some LLMs give special access to sites in their corporation, so I have to use those particular LLMs to get info I'm interested in. An example of this are the Alibaba sites. That is also really annoying.
As if all this wasn't enough, I also have to deal with Geoblocking from hyperscalers here in Asia.
There are walls going up absolutely everywhere these days. It's a scale of destruction of the open web we haven't seen in a long time.
My guess is that something programmatic will come out of this eventually, but until then there's going to be a lot of meatproxy work going on and flying 'You bot!' insults everywhere, bans etc.
What surprises me is that everyone is so busy blocking they can't see the financial opportunity.
Also, I would have expected people to discuss how they're getting around bot blocks through human assisted browsing. Quite the attention tax.