Comment A Little Common Sense (Score 1) 12
It just goes to show you, there's none more gullible than the paranoid.
It just goes to show you, there's none more gullible than the paranoid.
Right, but as I just said obeying a disallow directive isn't legally mandatory, so it doesn't mean much.
The difference depends on context, of course.
Generally speaking there are several cases to consider:
(1) Site requires agreeing on terms of service before browser can access content. In this case, scraping is a clear violation.
(2) Site terms of service forbid scraping content, but human visitors can view content and
(2a) site takes technical measures to exclude bots. In this case scraping is a no-no, but for a different reason: it violates the Computer Fraud and Abuse Act.
(2b) site takes no technical measures to exclude bots. In this case, the answer is unclear, and may depend on the specific jurisdiction (e.g. circuit court).
(3) Site has a robots.txt file and
(3a) robots.txt allows scraping. In this case, even if the terms of service forbid scraping, the permission given here helps the scraper's defense.
(3b) robots.txt forbids scraping. In this case obeying robots.txt isn't in itself legally mandatory, but it may affect your case if the site takes other anti-scraping measures.
Not *explicitly*. Offering such a database would be an invitation for people to look at the whole data broker industry. So what you, as a databroker who tracks and piegeonholes every human being who uses the Internet to a fare-the-well, do to tap into the market for lists of gullible yokels? You offer your customer, literally anyone with money, the ability to zero in on the gullible by choosing appropriate proxies.
For example, you can get a list of everyone who has searched for "purchasing real estate with no money down". Sad people who buy colloidal silver and herbal male enhancement products. People who buy terrible crypto assets like NFTs and memecoins. Nutters who spend a lot of time on conspiracy theory sites.
It's kind of like doxxing someone. You might not be able to find out directly that John Doe lives on Maple St and works for ACME services, but you can piece it together by the traces he leaves online. Only you do it to populations wholesale.
wait a week or two and the details will change completely.
Trump is nothing if not mercurial. His fans will tell you he's playing 11 dimensional chess... I have my doubts, but let's say that's true. The problem is that when it comes to the economy it's not chess. It's more like basketball, and the President is the point guard calling plays, except the play being called keeps changing before the players can execute the last call. It's a tough time to be running a business, you can't plan out more than a couple of weeks.
When I want to point out to the kind of morons who post on the Internet, I'll tuck this post away.
Yup, the sad truth is that if you really want to save children, you need to ban parents.
Right, the economist refer to this as "externality". Fossil fuels aren't cheap, if you factor in the costs that people using them transfer to third parties. Theoretically, if the true cost of using fossil fuels were factored into every pound of coal or gallon of gasoline consumed, then we would use *exactly the right amount* of fossil fuels. Probably not zero, but not as much as we do when we pretend pollution isn't a cost.
That's what they've done. Or rather they've bought the politicians who create the regulatory frameworks. But if people woke up and realized they've been frog-boiled into giving away their privacy, then that would be prohibitively expensive.
I essentially made the argument that if we want capitalism to work the way we were taught in civics class it is supposed to, companies must be forced by regulation not to undermine the basic assumptions that lead to efficient operation of the free market.
I am neither here nor there on a basic income. I think it depends on circumstances, which of course are changing as more and more labor -- including routine mental labor -- is being automated. We are eventually headed to a world of unprecedented productive capacity and yet very little need for labor, but we aren't there yet.
"Nuclear war can ruin your whole compile." -- Karl Lehenbauer