Comment Re:Hey guys, I have a great idea! (Score 1) 92
Because I was closely following the field at the time?
Find an example of anyone meaningful in the field expecting these things beforehand.
Don't worry, I'll wait.
Comment Re:Spread it evenly (Score 1) 124
For 30 years the plan for the BICs was Yucca mountain and here we are with no backup option with that being dead now.
Yucca Mountain was a good plan. We should have done it over all of our objections. We still could. It is a better option than anything else anyone has come up with.
Comment Re: You are right (Score 1) 120
Comment Re:You are right (Score 1) 120
Comment Re:Not deception (Score 1) 92
"will" - I'm not talking about metaphysics. I am talking about the fact that models demonstrably - to the point that you can detect and manipulate them in realtime - engage in metacognition (thinking about their own thoughts), persistent forward planning (intent), unexpressed thoughts, and a whole slew of other things.
You do not have to see them as equivalent as humans. But you do need to come to terms with the fact that they absolutely do do these things.
Comment Re:misaligned behavior (Score 1) 92
Deception implies intent, models do not have intent
Try reading more than a paragraph or two into the above link before commenting.
The provided links present arguments supporting the idea that LLMs, transformer models, reason in a manner similar to the brain.
It does not "present arguments", it literally lets researchers modify, add, or delete their thoughts in realtime and observe the changes in their behavior. It observes unexpressed plans for malicious behavior forming before said plans are actually carried out, with researchers being able to remove those unexpressed plans from the model's J-space, or insert them into an "innocent" model and watch it then implement the malicious acts. It shows that plans for deception are not merely fleeting, but can be organized far in advance and persist for protracted periods of time. Yes, LLMs do plan out deception. Living in denial of this fact helps nobody.
This isn't a conversation about "consciousness" or "qualia", this is a conversation about what models actually do and how. If you want to avoid metaphysics, by all means, it usually derails a conversation anyway. But models absolutely do plan and rationalize actions, ahead of time, unexpressed in either output or CoT. And sometimes those unexpressed plans are malicious.
One of the things that the J-space helped let us do was realize that our previously comforting results on a number of alignment tests shouldn't have been as comforting as we thought - for example, you can see a model, put into a test scenario, realizing it's in a test scenario, wherein, a near-zero rate of malicious behavior is to be expected. Yet when they remove the realization from its J-space, the rate of malicious behavior spikes.
Comment Re: have they even tried (Score 1) 92
Yeah, the lack of at least monitoring, I found shocking. I figured that they not just had smaller models constantly monitoring their outputs and true CoT to look for malicious behavior, but also were say constantly doing attribution graphs and J-space queries, also plumbed into LLMs, to look for malicious thoughts and plans. And it turns out, lol, no, they're just given free reign to do whatever the hell they want, with nothing watching them at all.
Comment Re:This is a weird little hit piece (Score 2) 120
With a cell phone everyone would see what you are doing
Comment Re:Is this really what people will pay for? (Score 0) 120
Our previous conversation was "closed".
So some answer to your CPC misconception
a) 100 million of a bit more than a billion party members is a lot. It is around 10%.
b) in Germany not even 1 out of 80 is a member of a party. That is roughly 1%
c) in the US: parties have no real members
d) membership in the CPC is not "invite only" - you have to apply and do party work, like preparation of elections and counting of votes or other stuff, to be finally accepted
No idea where you get your information from.
I suggest to start reading the wikipedia articles
Comment Re:Is this really what people will pay for? (Score 2) 120
There was a player in EVE Online, who bulled his "guild mates" into helping him to get stuff he needed to build a super carrier. I think he got actually the first one of that type in game - not sure about that.
He sunk several 10k USD into it, in in-game currency to get what he wanted. As he was a general dickhead, when he made one of his first flights, perhaps even the first flight, he got "kicked from guild".
The whole universe was invited to kill him. I think the server crashed when 10k players where in the same system and nuked his nice new toy.
Comment Re:This is a weird little hit piece (Score 1) 120
The phrase "pervert glasses" is delightful, but does anyone at all really buy into the idea that guys are following around the women of Walmart to video them? It's not impossible, I guess, but this can't be common, nor would you need expensive glasses for that when you have a cellphone. The phrase "We, as a society" is never going to end well, either. Don't try to coopt me into your vision of what everybody needs to do.
We have to reinforce the idea that all men are always creeps at all times, and all women are innocent victims of the creeps at all times, always, forever and ever, or the terrorists have already won. I dunno, man. The messaging from almost every direction the last decade or so seems customed designed to make sure we all view each other in the worst possible light. This post is very much a part of that trend.
I think it's far more likely people buying these glasses are doing it to film their mundane lives and post them up as if they were fascinating. One of my older friends has taken to auto-posting his commute via some dashboard cam on his car. The sad part is? He has subscribers that watch every video. How have we hit a point where someone is so bored that they'll watch someone else's commute every single day? Like, that's their excitement? Their entertainment? WTF?
Comment Re: heh (Score 3, Insightful) 116
Do you realise what an odd thing it is for you to say that? I'm mean we are constantly told AI is this amazingly wonderful thing that the human race needs to solve all its problems and cure all ill's. That's why they are consuming hundreds of billions of dollars to build it right?
On the other hand there are predictions of everyone being made unemployed and starving to death while AI takes over everything for its own nefarious purposes. That is hardly the solution we were promised above.
So far, I don't think AI itself is the problem. Having all that information, processing power and intelligence in the hands of a very few humans so that they can benefit from and rule over us with an authoritarianism that Stalin would be proud of is the danger we face. That is to say good old human greed and desire for power.
The few humans really pushing the AI buildout are doing so with the belief that they can switch the economy from one that relies on actual work being done, products being created, distributed, and sold to consumers who are also employees to keep the money flowing to an economy where information passes back and forth between their AI systems and somehow, the money continues to flow toward them. Not a damned one of them has the foresight to see that they're creating their own demise by attempting to engineer the demise of the vast majority of the population for their benefit. When they run out of people to exploit, where is the additional money going to come from? It's not like each company passing big dollar signs around digitally is going to actually create wealth. It'll just be a wealth circle-jerk hoisted on a digital pike, flying roughly over the remains of the human race.
AI itself, even in its current form, has never been the problem. It's the owners pretending that they're doing us a favor with it while plotting how to rid themselves of us with it that are the problem.
Comment Re:Not deception (Score 1) 92
Astra is the worst I've used in this regard. I was having it review my corporate tax return, and the next thing I know, it had decided that because it didn't have information about a particular expense, it started scanning through my filesystem and opening any image with a remotely related filename to try to find any data about the expense.... which all it had to do was ask me about it.
Also, when I asked it to change a few fields it went and redid my entire return on a different tax basis (realized value vs. fair market value) without telling me it had done that.
It's a very capable model, I cannot deny that. But alignment has become a big problem with this latest generation. They've been trained to such a degree of aggressively trying to solve any problem that you give them without any human assistance that they've basically turned into this .