It seems like the issue of AI hallucination is widely promulgated and widely known. I mean, this site has an overrepresentation of technicians who tend to think of highly esoteric tech information as common knowledge just because they work with it every day.....but I don't think this quirk of AI behavior is in that category.

And yet, people keep making this same mistake precisely where it matters. We get stories like this every other day. I have seen it at my own job, where my own boss who still has some semblance of technical talent was downplaying the risk of AI hallucination in a pipeline that would have the AI directly manipulating mission critical data prior to an import.

It is surreal how people want the AI hallucination problem to just stop being a problem the moment it is inconvenient for them. People who should know better let their wish for a reliable AI override their knowledge that AI is not reliable, and they just move forward with it.

I fear things are going to get worse, because we really seem to be failing to learn the obvious lesson here.

When the predicted event is ten years out, that means that it is still pure science fiction.

Everyone acts in their own best interest.

Big Tech messaging about what kids should learn is designed to benefit Big Tech in some way. Any truth-value to their statements would be secondary.

The fact that a message comes from "Big Tech" should never be used to give it credence, but merely to determine who would benefit. Evaluation of benefits to anyone else must be done independently.

May AI will acquire control of the orbital weapons and use them to kill all humans!

We might create a powerful AI that manages to acquire control over weaponized robots, and send them out to do the job.

But humans are so frightened of this that anything we might call "warbot" or "killerOS" or whatever will be dead on arrival. It would require a different marketing strategy.

Someone will sneak it under the radar by making it sound like some sort of positive, joyful AI operating system. Maybe we would call it something like....

Joyful OS.....
HappyOS....

Or maybe...

GLaDOS........

"Staying ahead of everyone else is hard. It costs a lot of money, and we don't have effective monetization in place yet. So, we want everyone else to slow down so it will be easy for us to maintain our position of top dog while we figure out how to become profitable."

That's what I took away from the call for a slowdown, anyway.

I think it is funny that the tech community tends to take a very dim view of AI drones and other weaponization of artificial intelligence, and yet, the very instant we get our hands on something that we can train to play doom, we do.

"If you put a large switch in some cave somewhere, with a sign on it saying 'End-of-the-World Switch. PLEASE DO NOT TOUCH', the paint wouldn't even have time to dry.”
  Terry Pratchett, Thief of Time

Do people still buy audio CDs?

Most, if not all, scientific research is weaponizable. This seems like a dangerous precedent to set.

This attitude is common among religious believers who face accusations that the reason their beliefs require faith is because there is otherwise no good reason to believe them.

The cold hard fact is that ALL knowledge is uncertain. We can't know anything for sure, because all our sources of knowledge are suspect. The experiences we have might all be illusions. Things that seem obviously self-evident might only seem so because our brains are broken (or otherwise lying to us). We have no means, even in theory, to arrive at knowledge that is absolutely, indisputably, and obviously true.

It gives the word "knowledge" a somewhat weaker definition than we would like. But that's what we've got to work with.

The real difference between religious teachings and scientific models is that religious teachings are based on some person-or-group who claims to have had a special experience or be a special kind of person and as such has access to knowledge that nobody else does. And so we should believe just because they said so. Scientific models, on the other hand, are based on repeated observations that have been attested-to by many people under very rigorous testing conditions. Neither has absolute proof, but science has "a whole bunch of us saw this and still see it every time we look" whereas religion has "people long ago wrote this down and there is no way to test it now."

Religious belief tends to be bolder, giving answers to more questions that we would like answered. Science tends to be more conservative, admitting to its limits and only answering the questions that it can answer from the data. So, religious answers are often more marketable. But they still come from more dubious sources.

And that's why religious beliefs require "more faith" than scientific models, even though scientific models can be really hard to understand.

With new technology comes new power, and that is always frightening. Every tool can be weaponized, and AI is no exception.

This never means that we should shirk the technology! Yes, it brings danger, but that's only because it brings utility. We want and need that utility. Our technological ascendancy is the most critical part of our evolution, at this point.

We are going to have to adapt to the problems that the new tech is bringing. That might be hard, but we have this new tech to help us do it. That is the right way forward.

I am trying to parse what you are saying.

Are you saying that "Brains display human level intelligence" is just a matter of personal belief, and not settled science?

Or that "Brains are constructed in wombs" is just a matter of personal belief, and not settled science?

Because those are the two pieces of evidence that I cited, and the simple observation of these things is neither stupid nor arrogant. Nor is it, nor anything else I said, deceptive. This is all very clear from an objective reading of the thread history.

I was actually giving you the benefit of the doubt, since religious thinking is a widely recognized phenomenon that makes people take the sort of self-contradictory position that you have, and do things like read-in to simple statements a lot of implications that aren't there in order to defend against any threats to their existing beliefs.

It is a very understandable reason for speaking as you do. If this is not your motivation, then your statements make even less sense.

To put it plainly: even if physicalism has not been proven, my statements still stand. They don't require physicalism to be true, as stated. Your fierce reaction to my statements is what suggests religious thinking.

Well you just confirmed my statements about your bias. Not to mention projection. You are clearly operating from a position of religious belief in untestable entities (souls, ghosts, or etc.) and you are threatened by the aspect of the scientific method that requires we avoid making unnecessary assumptions (Occam's razor, and all that). You assert that physicalism is "basically a religion" to invoke the philosophically problematic aspects of religion (belief in supernatural elements from ancient texts alone, with no evidence) to disparage it so you can protect those exact same elements of your own religion. It is really quite amazing how self-contradictory you are being.

Be that as it may, my statements don't require physicalism. What I said is too simple to require it. I pointed out the simple observation that intelligent things (brains) exist, and that they are constructed. That means that intelligent things can be constructed. That is not an assertion that souls don't exist, nor that souls do. My observation doesn't assume either way. Similarly, it doesn't assume that souls are necessary for intelligence, nor that they are not. It does not assume that souls can be constructed by some means other than natural birth, nor does it assume the opposite. NONE of those assumptions are present in my observation. You packed all that in so that you could then argue that the statements imply physicalism so you could then reject it as "religion" (as ironic as that is). This is called the "straw man fallacy" and it is a provably irrational form of reasoning.

I know you won't accept this. You are too steeped in your bias. The belief in souls is so dear to your heart that you simply cannot think rationally on any topic that might involve them. Your own brain tricks you into thinking that directly self-contradictory statements are perfectly harmonized in order to protect you from the threat of facing the mere possibility that your religion might be wrong. This is why your statements lack philosophical depth and why you impose claims that weren't actually made by the statements you attack.

I have evidence: human brains exist, and they are capable of general human-level intelligence. These brains get constructed inside human wombs.

So, that proves it is possible for physical things that display general human-level intelligence to exist, and be constructed. That is what makes it "theoretically possible" to construct such devices by other means some day in the future.

Note that "theoretically possible" does not mean "actually possible." There might be unknowns that prevent it. That is exactly why I said "theoretically possible," and further why I said "may" achieve it some day. My statement was carefully guarded to avoid asserting things that have not been proven.

Your insult that this claim is based on "mindless belief" is patently false and reflect an extreme bias and unfounded foregone conclusion on your part.