I guess the people making laws are still completely unaware that it is not them defining how reality works. Dumb and dumber ...

LLMs cannot be secured by guardrails. The easy and usually immediate jailbreaks demonstrate that nicely. Hence this "movement" has no chance of success.

What posting are you replying to? Because it is not mine...

Yes. One of the first things I change when installing Windows. Although I am not sure I will do that again, ever. Maybe in a VM.

Not true. New ones get added to the mix whenever MS makes Yet Another Really Stupid Decision.

These things are as old as the first computers with floppies or other removable media. Without the determined efforts by Microsoft they would have died out by now. So big kudos to them for keeping that part of ancient computing history alive!

In other news, IT Security people have no problems at all finding jobs, while coders really struggle.

That would be the sane thing to do. I doubt Microsoft is aware how bad their problem has become though, because their profits are excellent. And hence I think they will continue the enshittification until things cannot be repaired anymore. That point may already lie in the past.

AI hallucinations are not a new observation, even if people with no understanding of computing history think so.

Probably not much of a surprise, but always worthwhile to verify.

Indeed. I mean I did a few ChatGPT queries back when it came out and found its use a waste of time. I see the same level of incapability today in the AI summaries for Internet search and I am mostly ignoring these now. Occasionally I check and just find "still incapable". And while the paid models will surely do better, they will still not do well.

Yes. But most people do not understand NLP. They do understand "magic intelligent box", or think they do.

Obviously. Look at Musk's porn generator, for example, that does not mind undressing anybody underage, even when that is clearly illegal. Or at Googles AI summaries that may hallucinate stuff to the detriment of enterprises or people. This is a short-term money-grab and they do not mind if it all comes crashing down in a few years or tomorrow.

There is no AI tech that can do what GenAI is missing. All we have is actual human intelligence, but that requires expert-level capabilities.

Agreed. I get like 30% hallucinations in the AI responses to stuff I ask search engines now. But I generally do not ask simple stuff. The other problem is that for simple stuff, you do not need AI and its use will only have significant negative impact on your mental processes. And for advanced stuff (where you actually need to know and understand the simple stuff to verify the answer), hallucinations become pretty likely and so does missing context and caveats in the answer.

I do not see how this tech can be long-term useful for anything but the simple stuff. But there is is not cost-effective at all.

Hallucination are a severe problem whenever the damage is large. For example, driving a car, controlling an industrial process or writing software that will be exposed to the Internet. The problem is, humans generally do not hallucinate (unless they are managers or politicians or cult leaders and these all can and often do extreme damage), they are just somewhat off bust still mostly where they should be. Even a drunk driver is basically driving fine, just with reduced reflexes and capabilities. That is not the case for an AI hallucination. AI hallucinations can and will be completely off. And hence, safety mechanisms designed for humans do not work for AI and it may not be possible or economically feasible to extend them enough.

That is why scaling will not solve things. Effort grows exponentially bot in training data needed and effort of training the model. Hence, forget it. I am constantly surprises that nobody but the actual experts understand what exponential effort means. Incidentally, this is the same problem that will make sure QCs never reach useful sizes.