I typically challenge "AI" when it gives incorrect answers. And the outcome is quite predictable: "Of course, you are right, I made a mistake.. blah blah blah." It is comical, and it reminds me at every turn not to trust the answers.
So rather than sycophant I would say push-over.... just one data point, though a consistent one.
An honest human says something like "That's not an area I have much experience, but I guess that if you use concrete for the foundations the bridge will be fine. Maybe you should ask a civil engineer before starting on it? That doesn't sound like kind of thing you should just DIY"
let's quote my nearest LLM on that:
Yes, you can absolutely use concrete for bridge foundations. In fact, it's the most common and preferred material for this purpose
Isaac Azimov predicted lying [wikipedia.org], even under his 3 laws, but the result of challenging the lie was much more interesting: catastrophic failure; though not as spectacular as Nomad's [wikipedia.org]. So no, no big surprises here.
It's not that AI "knows" anything. It's just a big statistical web programmed with mass amounts of data leading to, eventually, a statistical output. Then the output changes by what's given as input. No surprise here.
I typically challenge "AI" when it gives incorrect answers. And the outcome is quite predictable: "Of course, you are right, I made a mistake .. blah blah blah." It is comical, and it reminds me at every turn not to trust the answers.
So rather than sycophant I would say push-over .... just one data point, though a consistent one.
An honest human says something like "That's not an area I have much experience, but I guess that if you use concrete for the foundations the bridge will be fine. Maybe you should ask a civil engineer before starting on it? That doesn't sound like kind of thing you should just DIY"
let's quote my nearest LLM on that:
Absolutely confident. Majority answer. Potentially seriously wrong
You don't get enough of this on slashdot, so you have to go get it form a chat bot?
Wow.
It's not that AI "knows" anything. It's just a big statistical web programmed with mass amounts of data leading to, eventually, a statistical output. Then the output changes by what's given as input. No surprise here.