Comment Re:She's got a point (Score 1) 174
Yeah that's where you lost us. Do you really think Israel is spending billion on AI to target some dirt farming civilian?
If you built software to do X and users are meant to use it to do X, then a bunch of people you control access to are consistently using it to do M over prolonged periods of time, regardless of your intent you have built software to do M. Furthermore, if M is a critical error that defies your policies and has happened multiple times over a prolonged timespan, that is either negligence or admitting that M is acceptable within the policies that govern usage. For any decent software engineer, that is basic logic. The stakes here are higher, but the logic is the same. Hence, my original post that she's got a point.
Comment She's got a point (Score 5, Insightful) 174
Comment Reverse Penalty (Score 3) 52
Comment Unusable & Unreliable (Score 3, Interesting) 19
Submission + - OpenAI Researchers Warned Board of AI Breakthrough Ahead of CEO Ouster (reuters.com)
According to one of the sources, long-time executive Mira Murati mentioned the project, called Q*, to employees on Wednesday and said that a letter was sent to the board prior to this weekend's events. After the story was published, an OpenAI spokesperson said Murati told employees what media were about to report, but she did not comment on the accuracy of the reporting. The maker of ChatGPT had made progress on Q* (pronounced Q-Star), which some internally believe could be a breakthrough in the startup's search for superintelligence, also known as artificial general intelligence (AGI), one of the people told Reuters. OpenAI defines AGI as AI systems that are smarter than humans. Given vast computing resources, the new model was able to solve certain mathematical problems, the person said on condition of anonymity because they were not authorized to speak on behalf of the company. Though only performing math on the level of grade-school students, acing such tests made researchers very optimistic about Q*’s future success, the source said.
Researchers consider math to be a frontier of generative AI development. Currently, generative AI is good at writing and language translation by statistically predicting the next word, and answers to the same question can vary widely. But conquering the ability to do math — where there is only one right answer — implies AI would have greater reasoning capabilities resembling human intelligence. This could be applied to novel scientific research, for instance, AI researchers believe. Unlike a calculator that can solve a limited number of operations, AGI can generalize, learn and comprehend. In their letter to the board, researchers flagged AI’s prowess and potential danger, the sources said without specifying the exact safety concerns noted in the letter. There has long been discussion among computer scientists about the danger posed by superintelligent machines, for instance if they might decide that the destruction of humanity was in their interest.