Right, but as I just said obeying a disallow directive isn't legally mandatory, so it doesn't mean much.

Yep. Imagine signing up to pay someone a subscription fee that you can get a night's sleep.

A reference to selling useless products to people.

Looking for health patterns that drug makers could use to target you for a sales pitch.

The difference depends on context, of course.

Generally speaking there are several cases to consider:

(1) Site requires agreeing on terms of service before browser can access content. In this case, scraping is a clear violation.

(2) Site terms of service forbid scraping content, but human visitors can view content and ...
(2a) site takes technical measures to exclude bots. In this case scraping is a no-no, but for a different reason: it violates the Computer Fraud and Abuse Act.
(2b) site takes no technical measures to exclude bots. In this case, the answer is unclear, and may depend on the specific jurisdiction (e.g. circuit court).

(3) Site has a robots.txt file and ...
(3a) robots.txt allows scraping. In this case, even if the terms of service forbid scraping, the permission given here helps the scraper's defense.
(3b) robots.txt forbids scraping. In this case obeying robots.txt isn't in itself legally mandatory, but it may affect your case if the site takes other anti-scraping measures.

Not *explicitly*. Offering such a database would be an invitation for people to look at the whole data broker industry. So what you, as a databroker who tracks and piegeonholes every human being who uses the Internet to a fare-the-well, do to tap into the market for lists of gullible yokels? You offer your customer, literally anyone with money, the ability to zero in on the gullible by choosing appropriate proxies.

For example, you can get a list of everyone who has searched for "purchasing real estate with no money down". Sad people who buy colloidal silver and herbal male enhancement products. People who buy terrible crypto assets like NFTs and memecoins. Nutters who spend a lot of time on conspiracy theory sites.

It's kind of like doxxing someone. You might not be able to find out directly that John Doe lives on Maple St and works for ACME services, but you can piece it together by the traces he leaves online. Only you do it to populations wholesale.

wait a week or two and the details will change completely.

Trump is nothing if not mercurial. His fans will tell you he's playing 11 dimensional chess... I have my doubts, but let's say that's true. The problem is that when it comes to the economy it's not chess. It's more like basketball, and the President is the point guard calling plays, except the play being called keeps changing before the players can execute the last call. It's a tough time to be running a business, you can't plan out more than a couple of weeks.

When I want to point out to the kind of morons who post on the Internet, I'll tuck this post away.

well played, well played lol

Accurate statement: "Humans invented a way to harness CRISPR/Cas9 to create transgenic organisms"

Inaccurate statement: "Humans invented CRISPR/Cas9"

This isn't complicated.

https://fosstodon.org/@AkaSci/...

Yup, the sad truth is that if you really want to save children, you need to ban parents.

In the new CEO's expertly crafted I-am-villain statement; he explains: "The past, he added in an email, is “simply not relevant to the new future.”"

I, um, guess it was polite of him to not talk about "the bigger picture" to the people whose eyes he shut down?

Will these ones retain vendor support longer than the last batch?

If there were animals adeptly using fire long before humans existed, we would not call humans the first to "master fire" just because humans understood what they were doing.