Comment Re:Independent? (Score 1) 123
Who is paying those independent evaluators?
According to some sources, the "independent" evaluators are pretty much family and cult members of those training the models.
Who is paying those independent evaluators?
According to some sources, the "independent" evaluators are pretty much family and cult members of those training the models.
What they don't want to admit is they used loose shitty instructions to get it to do something to derive results but don't want to take responsibility when they got caught.
There are already a bunch of people putting LLMs out there with loops to try to achieve a goal by exploring around. That can include them to instructing other other LLMs.
"They" (whoever they are - it includes small children messing around with OpenClaw) have no idea what they instructed the LLMs to do.
You will get an AI toaster and you will like it!
(Unless the damned bubble pops)
Getting the toast actually brown but not burnt, and getting both the different sides of a bagel right actually sounds like a real valid use for AI. I think it's a proper hard problem, as the failure of various toasters with browning sensors shows clearly. My only fear is hallucinations leading to house fires.
It did not happen
I guess you are probably right, however there's a comment on your twitter thread:
Look in the training data and confirm/deny that Buckmaster's data is or isn't in there. Until you do that, it's very very hard to trust anything OAI says or does.
and until you see that and compare also with his and other mathematicians unpublished work, which might be where the more advanced proof came f you cannot be 100% sure. Their refusal to publish the inputs, including all of the training data they used for this model together with its sources, is a big problem.
I always thought mathematical problems were meant to be solved because their solutions could somehow improve our understanding of the world and, ultimately, the human condition, not merely because someone could be the first to publish them.
No. There are many mathematicians (N) and there are probably many more opinions about why they do math, with "because it's fun" or "because I read about the notes in the margin and always wondered if I could be the one" probably at least as common as "understanding the world". If you want to understand the world you become a physicist, a biologist or, if you are young and naive a sociologist.
Also...
""I think it's pointless. Like, I think the game is up...."
Buckmaster thinks research is a game, that the knowledge obtained is pointless in itself and that what he engages in is a game for his personal benefit. Sounds more like a sociopath than mathematician.
Plain paper mathematics is not like, for example, physics or sociology. The resources you need for much of it are much smaller and are at the level that it's reasonable for universities to give people just for being good at what they do, not because of the value they give humanity. There's a good history of people doing research entirely for their own pleasure and entertainment and that turning out later to be useful, often contrary to their own explicit wishes (look up the history of matrices). Let's not throw the baby out with the bath water just because one such person has a bit of a tantrum.
Trump is stopping Iran from selling its oil.
What have you done?
Railed against Trump online, making Right wing American's mad and ensuring that they went out and voted for him thus destroying much of the oil based economy. There's an honest shift to solar energy in East Asia driven by the Iran crisis that would never have happened without this fortuitous turn of events. China had a massive overproduction of solar panels to the extent that even with the new situation they still have too many for the companies to be profitable. Large amounts of this production have now been saved from immediate bankruptcy.
All caused by angry right wingers.
Which is why I'm not at all convinced he believes this. If he believed that, this action is too small a response. Nothing short of Butlerian jihadism is an appropriate response, if you actually believe this.
I for one think it is believable that a person does not want to remain part of something they think has a 10% chance of killing everyone, while at the same time not thinking it would be worthwhile to dedicate the rest of one's life to a fight against that something. Maybe he rather wants to spend whatever many years remain with activities he enjoys rather than with a futile attempt on convincing the entire world to abandon a technology that may kill everyone, but also may provide "the first to perfect it" untold riches and power.
the argument loses validity if the result is catastrophe for all.
If the only realistic outcomes one sees are either (A) "Me becoming enslaved by that enemy" or (B) "Everybody dies", a lot of people will favor (B) over (A), and historically already did so with regards to the nuclear "mutually assured destruction" doctrine.
"Live or die, I'll make a million." -- Reebus Kneebus, before his jump to the center of the earth, Firesign Theater