Comment They don't know why it works and that's a concern (Score 1) 189
The former head of the MIT Artificial Intelligence lab, said, in an open courseware lecture, linked here at between 14 and 16 minutes, said they don't know why it works and that they were astounded by the results produced by Geoffrey Hinton who introduced the first vastly larger neural network and ushered in the modern era of AI.
Geoffrey Hinton, associated with University of Toronto (he was Ilya Sutskever's phd advisor) has been warning about the risks of AI for some time.
The neural network roughly simulates how the brain processes information. It is the general design that nature came up with and now man is harnessing (the first commercial neural networks were used in the 90s for check scanning OCR).
They know that scaling up can eventually create a superior information processing system to the human brain. They don't know for sure. But it's a risk. THAT'S what they're concerned with primarily. If you listen to Hinton, social upheaval is also a risk.
Yes, big companies DO use all their tools, like purchasing politicians and using regulation, to squelch competition and get an advantage. That anti-competitive behavior should not obscure the risk of AI. No one knows why the LLM's can produce the results that they do. They think scaling up will make it more powerful than a human brain - but maybe it won't. I saw a study which said LLM digital computing consumes 900 million times more power than biological computing. Maybe that will limit it - until they make it more optimized.
The LLM is a digital system. It has no nervous system, no feelings. It processes information. It roughly approximates the way nature processes information with brains. They need to get a handle on what the risks of using a super-powerful information processing system like this will do.
If you want to understand the real risks, it pays to be skeptical of these companies. The best bet is to listen to top academics who are not commercially associated. Hinton is the top among them. I don't agree with all his theories - he misses, it seems to me, that the system has no nervous system. But when he talks about its information processing capabilities and what that could mean for humanity once that system becomes more powerful than humans is worth listening too.
People need to be skeptical, but not too clever by half, when thinking about the risks of AI.