Comment Re:If we go with the mind being emergent (Score 1) 27
It's IMHO amazingly impressive how dense information can be stored within neural networks. Even a comparably tiny LLM can store more information than the human brain, despite the brain's theoretical storage being far higher due to its vast number of connections (ANNs are better at information density, we're better at learning from limited datasets). The tiny LLM will crush humans at a quiz in virtually anything except said human's particular areas of expertise. Storing information as a superposition of states across a large number of neurons and connections (whether we're talking artificial or biological) is an immensely space-efficient way to do so, and the human mind is nowhere near the limits of information storage capability.
There is no technical reason why a given organism, such as a bee, could not achieve far denser information representations in order to be able to do more with its limited neural capacity (though there are always tradeoffs). One of the reasons that ANNs learn slower-but-denser is the use of a very low learning rate with a very large amount of data that covers the same topic from many different angles, giving the weights ample time to explore different possible circuits in parallel and seeing which ones predict reality the best ("learn everything all at once" vs. "learn this thing NOW"). Bees aren't tasked with learning anywhere nearly as diverse things as a human is and spend all day doing the same basic job (the same information "from different angles"), so it seems quite possible that their greater "information specialization" as they go about their day may be able to lead to denser representations of said information.
BTW, at risk of a tangent (your comment about non-neuron cells playing roles), it's been really interesting to me seeing how a key difference between artificial and biological learning has been clearing up. In biological neural networks, weight cannot flip sign (Dale's Principle). In the general case, a neuron is either excitatory or inhibitory (usually a small number of inhibitory neurons per cluster of excitatory neurons); it can't change from one to the other even if learning would favour that. At a first glance, that would seem to cripple learning capability (and definitely does if you implement that in ANNs). But what appears to actually happen in biological neural networks is a sort of horizontal learning, co-dependent synaptic plasticity, between excitatory and inhibitory neurons. Instead of merely weakening an excitatory connection down to zero and then being able to go no further, learning simultaneously weakens the excitatory connections and strengthens the inhibitory connections. The excitatory neurons are the primary drivers of information storage and processing, but the inhibitory neurons adjust the baseline to give them the flexibility to express negative net activations as needed.