Comment Re:Training data (Score 2) 77
Your post was quite reasonable, and probably true, until you wrote "AIs aren't capable of reasoning". There *are* definitions of reasoning for which that it true, but they aren't the ones in common use. Cicero would use that kind of definition in his "school of rhetoric", where he taught people how to win arguments". Socrates would not. He was trying to find truth.
Clearly AIs have limited reason. They can (at least in principle) do perfect logic, but the difference between that an reason is not well defined. (And logic can prove that you can't prove algebra to be self-consistent.) To me reason is evaluating a set of data and a goal, and using logic to plot a nearly-optimal path to achieve the goal. I think where AIs are generally most deficient is in their goals, though obviously they also have an imperfect understanding of the current state. (Well, so do people.)
That said, there are many areas where current AIs seem deficient when compared with people. This doesn't mean or imply that they don't have a modest amount of the features that they are deficient in, but merely that we expect them to have more. Think of capabilities as being gradients rather than boolean variables. This is commonly called "jagged capabilities". They're better at some things than most people are, and worse at other things than most people are.