Forgot your password?
typodupeerror

Comment Re:Why? (Score 1) 20

We don't know the exact answer yet, but IMO, you're two-halves right.

The key difference is, humans aren't "trained" primarily via a clean library of tagged data (which in itself is a learned skill). We experience the world as a more-or-less continual stream of noisy data from our several senses. We self-train how to interpret (and primarily, filter) sensory data; and more importantly, how to derive new training data from it.

To be clear, I'm not saying we have so many neurons to support input filtering (though that's admittedly at least partially true). I'm saying we virtually can't run out of new training data. Every second we're alive, it just keeps coming in.

Comment Why? (Score 4, Interesting) 20

Current top models are already undertrained by multiple orders of magnitude vs their number of parameters. Not for lack of will or money, but for lack of data - We're already training top models with effectively the entire digitally-available corpus of human knowledge and need about a thousand times more.

That said, the huge Chinese models we've seen lately aren't single models, they're MOEs - Effectively a hive-mind of many smaller models working in concert. Bytedance hasn't mentioned that detail yet but it would somewhat mitigate the training issue. This is still absurdly over-spec'd though. There's simply no way to train it any more than all the rest starving for data.

Comment Re:Suggests abiogenesis is easy (Score 2) 84

At this rate we will end ourselves with AGW before we achieve AGI.

But if not that, it'll be nukes or biotech.

It's looking increasingly like the great filter is that ambition exceeds ability while ability also exceeds restraint, and at the same time, a species gains the ability to destroy itself. TBF our sample size is small, but it remains compelling...

Comment Re:Ivermectin is better (Score 1) 198

Hell, your parents were busing gene editing when you were conceived

Really? They were deliberately choosing genes? They selected them from a list? We usually only see that in science fiction, please provide more information on this amazing technological development!

Slashdot Top Deals

After the last of 16 mounting screws has been removed from an access cover, it will be discovered that the wrong access cover has been removed.

Working...