There's a lot of info available about attack mitigation (or just hungry crawlers) and how to avoid/blackhole them. Problem is, you have to have control of portions of the network stack to do them effectively.

Security through obscurity only works so long as you can be obscure, which is part of the vibe of the post. It's really stressful sometimes, depending on what's hosted.

Of the sites I don't have behind Cloudflare, the assets aren't worth anything and I truly don't care if they show up in AI. Otherwise, what's mine is mine, and not theirs.

If you can afford it, also consider Cloudflare; their bot identification is really good. You can use defaults or make your own filters. They're not the only ones that do this, but my experience with them has been positive. Much depends on your skills in how the web actually works, network + site interaction.

Their protections are cheap for the quality/speed. All of the large sites I manage are behind Cloudflare, including their DNS. Their DNS management is superior, and has interesting tricks for mixed-media sites. I don't work for either of these companies.

Get Wordfence if your site is Wordpress. The controls inside (free version) are enough to rate-limit crawlers effectively.

If you don't have Wordpress, your choices are more complex; you MUST use an IP filtering system and front-end your site with it to rate-limit everyone methodically. Crawlers eventually quite.

Many crawlers identify themselves in the get/post sequence. You have to parse those. If you understand fail2ban conceptually, it's the method used to create like-type gets that score with higher rates, and folder transversals. Accumulate your list and band them/null-route/block or whatever your framework permits.

Yes, you can blackhole through various famous time-wasters, but this also dogs your site performance. Captcha and others are becoming easier to fool, and for this reason, they're not a good strategy.

Once you decide on a filtering strategy, monitor it. Then share your IP ban list with others. Ban the entire CIDR block, because crawlers will attack using randomized IPs within their block. If you get actual customers/viewers, monitor your complaint box and put them on your exemption list.

There is a difference between "secret" and "Don't Crawl Our Site".

It's almost impossible to masquerade as a human; even throttled crawlers are easily identifiable through many different and often evil traits used.

The kleptocracy of AI (and other) crawlers is what's at issue.

The entire post is a B-Movie, save the misunderstood public danger from just crappy construction. I wonder what else they'll find.

Marvel should get the rights. Maybe a Disney movie about WaspMan, to compete with the aging and tired Spiderman franchise.

While no one was looking, apparently, there was other news, like CPB going dark and Tesla being fined nearly a quarter billion dollars in liability due to premature auto-driving feature use.

But no, wasps. Radioactive wasps.

Trump took the EU to the woodshed. They had to drop all of their protectionist tariffs they have against AmeriKKKan goods(I thought protectionism was ad?) and in return America puts a 15% tariff on all of theirs. Moreover they had to write a check to us for hundreds of billions. The tariffs will bring in a shit-ton of money. We can use this to replace the income tax and repeal it entirely.

The usual TDS sufferers are screaming it's a tax on AmeriKKKans but it's not. When's the last time an American bought anything made in Europe? I mean one of us, not the CA/NY American passport holders who write the media articles describing what happened.

Hey, I've got an idea - make things in America and there are no tariffs. It's weird but worth a shot, it could work.

On the contrary, it will have a ton of good effects. All DoS attacks will stop. Fraud will crash and stay there. Email spammers will go away. When alt-right trolls get banned, they will STAY banned. Forever. Imagine an internet without them. A boot stomping on 4chan's face, forever.

This is going to fail bigtime. Nobody will move there for jobs. As a tech professional, I would rather eat glass than live in a flyover state. I have in-demand skills and I have zero desire to live in places that are small minded, lack immigrants, and lack interesting and rich culture. The tech sector is chock full of diverse immigrants and unique people who have no desire to live in a conformist mono-chromatic culture. Tech talents don't want to eat breakfast at the Waffle House.

You live in a tiny universe. See the NTIA's band plan to understand just how narrow your thinking is.

We agree that the cuts in the science budgets are heinous.

Nonetheless, the world is filled with *useful* radio.

Nothing trumps nothing. Your values, narrow as they might be, show your misunderstanding of spectrum management and usage.

There are asserted and managed radiological quiet zones. That's as good as it's going to get, until receiver discrimination improves, or external/satellite data permits improvement on reception. That's my best hope for fetching this data. Think: Dark side of the moon.

Soon the earth will be covered in satellites, a layer not unlike Asimov's Trantor.

If there's a compelling need to allocate spectrum for astroradiology, there are mechanisms for this. The post cloyingly and insanely believes their need is compelling over all of the other allocations already made.

There's a seat at the table available, but the process is well known, and their need isn't prioritized by the intense need to precisely correlate the earth's position in the universe by listening to black hole songs.

Do you realize you had an intrusive thought, wrote it down and started railing against something that nobody said? This is literally Trump Derangement Syndrome. Please, see a therapist. CBT does wonders for people in your situation. Don't suffer needlessly. It doesn't have to be like this.

They're not in the home gym business. They're in the data harvesting and selling business.

Your data is worth more than the profit margin on their exercise equipment.

This is the world now, and you cheered it on all the way.

Even Google won't allow you to watch random Youtube videos any more without "sign in to prove you're not a robot". Google, the original evil privacy rapist.

We got a solid ten years out of them before they went evil, I guess that's pretty good. LLMs are where Google used to be in the year 2000, an improvement on search engines that blow the existing products away. Remember how awful search engines used to be? Then Google delivered actual good results. Then they took away the + and - operators and started censoring politically inconvenient content by removing it or demoting it to page 137 of results.

The established theory held. The gold exploded as expected.

The only interesting thing about this finding seems to be that they have a very fast thermometer, so fast it could get a reading of temperature within the trillionth of a second window as the gold was in the process of exploding.

Also, can anyone envision a "spaceflight" application of this? I wasnt aware speedy thermometers were a major barrier to space flight development.

At last someone is willing to tell off the little people to their faces. It's heartening to see even in this day and age of open nullification of federal power in California and others that someone supports the US government. You tell those deplorables how it is! Speak truth to the powerless!