Comment Intelligence != knowledge (Score 2) 105
Knowledge is an aspect of intelligence, but having it is not intelligence itself. And LLMs are "knowledgeable" in the sense that they have at their disposal vast datasets of human-compiled information. This is not in doubt.
In the sense that a machine can, through various algorithms, look up that information and through a statistical model, produce output that simulates understanding of the meaning of that knowledge, that can constitute "intelligent" behavior. Because its ability to retain and recall information is superior to humans both in speed and breadth, it can do things with that information that, in comparison, humans cannot do. Again, this is not controversial. Prior to LLMs, such capabilities have been true of many specialized domains--mathematical computation, chess, search engines. LLMs simply constitute a new model for information synthesis and retrieval.
Can these algorithms generate "new" truths (where by "new" we mean things that humans previously did not know)? Yes. But these truths are found by extensive analysis and synthesis of the knowledge present in the training data, through a computational process that is only in some ways more efficient than a human.
Does this behavior constitute "intelligence?" In some limited respects, yes, but it cannot be said that it is anything like human intelligence. The latter is far more nuanced. Human intelligence is inextricably entertwined with understanding, emotion, creativity, imagination, passion, will, desire. It is a disservice to ourselves and to that which we create to believe that LLMs could ever achieve this kind of intelligence. We may be able to get it to simulate aspects of it in some fashion, but as long as we do not understand the origin of consciousness, it will never be truly capable of human intelligence.
Whether we as a species should be pursuing the development of an artificial consciousness is a separate question.