Slashdot is powered by your submissions, so send in your scoop

 



Forgot your password?
typodupeerror
×

Comment Without AGI, it still takes an artist (Score 4, Insightful) 162

Someone has to make a logical composition and clean up the AI bullshit. There isn't enough training data in the world to fill all the "corner" cases for AI to hallucinate bullshit into. It's "just" a productivity enhancer.

Once AGI is here, we'll have different things to worry about.

Comment Apple will own all (Score 1) 155

No one else has the matching incentives and long term income to build brand in the same way in the age of ecosystem. Google being build on advertising and way too loose licensing for Android couldn't build a high end ecosystem if they tried at this point and they clearly aren't trying. Microsoft isn't even playing.

Comment Meh ... (Score 2) 40

Hyping everything just because it's from Apple is a little silly, only the LLM in a Flash paper deserved it (though it's mostly a variation of the theme in "Low-Rank Approximations for Conditional Feedforward Computation in Deep Neural Networks").

Making a digital assistant work better with random app/websites is nice, but outperforming GPT-4 on something it was never designed for is hardly impressive. The whole one-shot, unlabeled data spiel from the early GPT era was just hype, multimodal doesn't make the difference ... good labeling and supervised training/finetuning makes the difference.

Comment Re:I actually don't think this is a bad metric, bu (Score 1) 19

On the other hand, the method can be directly used for reinforcement training and it only has to look good. You can probably even train a classifier to recognise chatbot arena queries well enough so it doesn't pollute functioning in other benchmarks.

I suspect Claude is close to an inflection point where models are reinforcement trained specifically for the public benchmarks du jour. Was GPT4 to the same level? Maybe, maybe not. Everyone in the industry is going to have to start doing it now though.

Slashdot Top Deals

What is research but a blind date with knowledge? -- Will Harvey

Working...