I would argue that giving the AI agency is like taking both hands off of the steering wheel and reading a book instead of properly driving.

Essentially there appears to be a hole in understanding. Whatever dark matter may be, if it exists, it must fit the hole.

Now imagine instead of factory workers, the machines randomly ripped arms off of people who had no association with the factory.

I don't suggest holding the AI responsible, I suggest holding it's USER responsible, just like the driver is held responsible if they fail to keep their car under control and plow into pedestrians.

Since the Wealth of Nations is the cornerstone of Capitalism, I would expect people cheerleading for it to read it. Smith is not god and economics shouldn't be a religion, but The Wealth of Nations is key to understanding how it can work for the benefit of all. His warning about corporate charters was in part inspired by his observation that corporations know nothing of compassion. I'm quite certain that by exceedingly sparingly, he did NOT mean to anyone who fills out a form and pays $150.

Competition also meant more than having 2 or 3 sellers to choose from. He envisioned many sellers and many buyers who were not that far apart in economic power (not his exact words but the jist is within a couple orders of magnitude). I have often observed that the modern economy shows inadequate competition in most if not all markets. Given adequate competition, "value pricing" would be practically impossible.

Agent mode is also where the AI decides that committing a felony is an acceptable risk (even if it isn't). Ask an AI based robot (I know, not yet available) to go buy an ice cream at the truck and it decides the kids surrounding it are an impediment to it's mission and shoves them into traffic.

It might change people's minds if they are made strictly responsible for any crimes committed by the AI.

More real life, an AI decides the production database needs to be deleted even though told not to touch production. AI later matter of factly states it ignored that instruction and the database can't be recovered.

You said home ISPs sought to deploy Trusted Network Connect about 20 years ago. It hasn't happened. What's holding it up? The rise of mobile devices, smart TVs, and other devices incompatible with the remediation means available in quarantine?

It's more like unpredictable software. I'm not saying we burn it, I'm saying don't give it agency. Only allow it to advise, not take action. I have experimentally used it myself on code, but did not allow it to commit to the repo, only show me it's proposed changes. It even proved somewhat useful at that, though I didn't apply it's changes, it did inspire a similar approach that I implemented and committed.

That a Teflon like surface takes part it? That is new ground.

A key to Capitalism from Smith himself is that it requires strong regulation to keep the playing field level. Smith also warned that charters must be given out exceedingly sparingly and the resulting corporation kept on a tight leash and held strictly to it's charter.

I guess we really blew that one!

But I rather doubt anyone involved in MAGA or others shouting "deregulate all the things!" have ever read "The Wealth of Nations". Most probably can't do it since centuries later the text is quite stilted.

There is no implied malice, that would require understanding what right and wrong are. It doesn't. The training so far for the various AIs seems to be whatever we can grab from the internet or scan from whatever books we can get our hands on.

Are you claiming LLMs are written to create fake social media accounts and launch a smear campaign against a project maintainer who refuses to apply the AI's PR? Because that actually happened. It was prompted to make a few requested changes to a program and get a PR accepted with those changes. And that's what the bot did, BY ANY MEANS NECESSARY.

Put another way, would you run a makefile containing several billion rules that you are not allowed to examine first? Because that's what giving agency to LLMs is. Or might you prefer a debug mode where it shows what actions would be taken, but cannot take them? That is what I mean by not giving it agency.

Well, technically, we're letting Natalie do it, which is, of course, worse in every way imaginable, since she's immune to the sense of embarrassment that sometimes restrains him from acting on every little whim.

To be honest that was actually my first theory, since the bots didn't seem interested in exploring the rest of the domain. I suppose there's no way to know for certain. I concluded that it must be an imbecile's attempt at harvesting, though, because the queries weren't really exploring the string space in any useful way. Here's a sample:

"GET /index?author=15&go=Search&id=48&name_restrict=1&q&re&results_&results_pagenum=2980 HTTP/1.1"
"GET /index?author=2&go=Search&group=0&group_restrict=1&id=48&name_restrict=1&q&results_pagenum=5440&template=41&type HTTP/1.1"
"GET /index?author=15&go=Search&id=48&name_restrict=1&q&results_pagenum=33500&templat HTTP/1.1"
"GET /index?author=15&go=Search&id=48&name_restrict=1&q&results_pagenum=32640&templ HTTP/1.1"
"GET /index?author=15&go=Search&id=48&name_restrict=1&q&res&results_page&results_pagenum=39300 HTTP/1.1"
"GET /index?author=15&go=Search&id=48&name_restrict=1&q&results_&results_pa&results_pagenum=12340 HTTP/1.1"
"GET /index?author=2&go=Search&group=0&group_restrict=1&id=48&name_r&res&results_pagenum=6100 HTTP/1.1"
"GET /index?author=2&go=Search&group=0&group_restrict=1&id=48&name_restrict=1&q&results_pagenum=2920&te HTTP/1.1"
"GET /index?author=15&go=Search&id=48&nam&results_&results_pagenum=17940 HTTP/1.1"
"GET /index?author=15&go=Search&id=48&name_restrict=1&q&results&results_pag&results_pagenu&results_pagenum=37720 HTTP/1.1"
"GET /index?author=15&go=Search&id=48&name_restrict=1&q&results_pagenum=9360&template=41&type_r HTTP/1.1"
"GET /index?author=15&go=Search&id=48&name_restrict=1&q&r&results_pagenum=28040 HTTP/1.1"
"GET /index?author=15&go=Search&id=48&name_&results_pag&results_pagenum=10400 HTTP/1.1"

The only thing this is fuzzing is the query string parser. It's not testing the limits of string buffers, it's not using interesting characters, it's just brain-damaged. The fact that it's also fetching different page numbers shows it's trying to follow page links and failing badly at doing so.

The site gets plenty of sniffing from garden-variety pests. e.g. this half-hearted attempt to find a framework or two that I don't have:

"POST /__rsc HTTP/1.1"
"POST /api/auth/session HTTP/1.1"
"POST /api/auth HTTP/1.1"
"POST /__nextjs_action HTTP/1.1"
"POST /.action HTTP/1.1"
"POST /_rsc HTTP/1.1"
"POST /api/auth/callback HTTP/1.1"
"POST /_middleware HTTP/1.1"
"POST / HTTP/1.1"

(of course, none of these URLs exist other than /, and you definitely can't just POST to it)

All this said... I've seen that spammers regularly misconfigure their tools, they'll try to register accounts with names like #[X:\LISTS\NAMES.TXT] and it only makes sense that some other cybercriminals trying to get rich quick have a similar lack of interest in programming shit correctly. Generally people don't turn to script kiddie shit if they have a personality conducive to putting in an honest hard day's work perfecting their craft.

Issues with the big red switch cannot be addressed in software. But you knew that, right?

AI is quite different. Nothing in Kali is going to do anything really surprising. If you ask it to launch X,Y, and Z attacks against a.com, that's what will happen. It will not suddenly blackmail Joe Random nor dox the Postmaster General. It won't try to recruit a server at b.com to it's quest. It won't try to steal cycles from someone's heart monitor as a distraction. It won't go shopping for a professional arsonist on the dark web. It won't even submit a bogus brief to a court citing non-existent case law.

Note that of the absurd things I suggested, only one of them is complete fiction on my part.

I believe the plan was to give that sobriquet to Lake Michigan, in honour of its decidedly flaccid silhouette.