Forgot your password?
typodupeerror

Comment Re:Shifting expectations (Score 1) 44

The Turing Test has long been considered highly defective. It also doesn't mean "a person thinks the computer is alive". It means "the person thinks what they're talking to isn't a computer".

If you wrote a program to write out random clusters of adjacent letters, and had people try to guess whether they were talking to a computer or a cat walking on a keyboard, a lot of them would guess wrongly that they were seeing a cat walking on a keyboard. That doesn't mean that any of them think computers are cats, that there's some simulated cat brain running in software - every one of them, on being told that it was a program, will assume "the program just writes random adjacent letters".

The Turing Test and the supposed "ELIZA Effect" are not the same thing. The ELIZA effect argues that humans, encountering chatbot, assumes that the bot has intelligence or other human traits when they don't.. The reality is that humans almost always assume that chatbots are elaborate tricks - even if they enjoy playing with them. It's like attending a magic show - people enjoy engaging in the illusion of the magic, but almost nobody thinks that the magician is actually engaging in real sorcery, regardless of how real it looks. It's "Huh, I can't figure out what trick was used to create that effect, that's amazingly well done!", not "There is no logical explanation, so this person is a literal sorcerer."

If you're looking for a real psychological effect related to AI, look to the AI effect.

Comment competition (Score 1) 97

I cannot begin to imagine the in-fighting, maneuvering and calling-in-of-favors behind the scenes to get that job. The board so clearly rejecting a return points to all of them already having received a dozen bribe offers.

Why, yes, I do believe corporate America is corrupt to the core. You don't get into these positions without greasing hands and sucking dick.

Comment Re: At least half true. (Score 1) 59

At some point being faster is a liability if you feel compelled to "make the most of it". Impossible to apply that 'lot of judgement' when you get a gigantic ball of code submitted within a short window of time. I think pointing fingers at the patch is *absolutely* warranted if it turns out that the slopped up patches end up kneecapping the code more often than it happened before. Yes tighter testing discipline is *absolutely* needed, because the patches have gaps that no one is used to expecting, and certainly not going to find in a multi-thousand line merge request submitted by some entry level guy that asked Claude to add some unasked for feature that he thought was 'neat' that touches just tuns of unrelated code for no sane reason (most recently, the guy seemed to induce it to make every call to an external library only be called from a single place and rework all calls in a file to call a 'helper' to call the function from a library, impossible to review volume of code for zero benefit, and offtopic for the alleged meat of his request).

Comment Re:It Gaslights in Natural Language (Score 2) 59

It largely is, and it can be mitigated in many scenarios where an objective test can be run quickly to prove/disprove whether a change worked as intended. This is a critical ingredient in having codegen work, otherwise it will *look* reasonable but have screw-ups. I highly suspect the Microsoft change was likely slopped up and looked reasonable but had a huge gotcha.

But either way, in a vulnerability seeking context, this isn't a huge liability, though it is an inconvenience. Security team started using one of the models on a private codebase and it flagged 60 "issues". Of which, 58 were ultimately not actually issues upon human review, but it found two that had otherwise gone undetected, and two is enough.

Comment Re:Anthropic PR (Score 1) 50

Note that based on what I've seen, while it is certainly true that foreign companies don't get as much value out of their contracts as they would have liked, when they go with the "handshake, money comes later" they can get even more screwed.

Recently saw one such situation where one part of the company was livid that some team had been pushed to do work with neither up front payment or a contract, and the sales team saying "that's just the way things are done culturally here" and surprise, they never got payment.

The "no contracts, just vibes" approach should be an impossibly huge red flag when you get to this scale of operations, even in that region.

Comment Re:Anthropic PR (Score 2) 50

I agree with that, though huge chances the circular funding won't care which CEO is in charge either. To the extent they think it fuels their bubble, they'll keep at it.

I think there was some indication they started shrinking the circlejerk of funding a few months ago though, causing some of the darlings to have pretty catastrophic crashes when their 'business model' of income just being nVidia money to buy stuff back from nVidia evaporated and they had not proven any viable *actual* business yet on their part.

Comment Re:How much of this is due to reduced code quality (Score 1) 42

Well the FAA thing, at least if they are being truthful, sounds something like either a BGP screwup or a broadcast storm (we only get the answer after the telephone game through politicians). Which doesn't rule out AI bullshittery (they could have asked Claude for a good router config and taken it at face value, I know one person who did do that and sent it to a technician and I was able to interject because it did explicitly connect broadcast domains that were supposed to be distinct).

Microsoft and banking are squarely in the realm where AI codegen is likely a component.

In terms of what to look for, for the bullish AI management, it's damn near impossible. Someone submitted a pull request of thousands of lines of code ostensibly for a very minor change. Management is questioning the decision to block it because it's too big to plausibly review and that much change is extremely bad smell for the goal. However 'Claude audited it' so it *should* be good, and are we just being luddites? In my case, we still win in practice by rejecting it, but from public reporting it sounds like some other organizations may not be so fortunate.

Comment Re:Safety last (Score 1) 77

It's not really the automation that's the problem, it's the lack of follow through.

Good, it's automatically monitoring the chemicals. Bad, it doesn't actually do anything about it except send an email.

If it was fully closed loop automation complete with clear and audible local alarm, then that would have been great. Though one could say it should still be backed up by a human doing a periodic manual check, just like my local cheap pool does every 30 minutes or so.

Slashdot Top Deals

If Machiavelli were a programmer, he'd have worked for AT&T.

Working...