I wonder about this as well. Old guy here. Back in the days I started programming (qbasic), I was impressed when I had a compiled program of 100 kbytes! Took a lot of work to get that far. These days, a simple form that does some calculations is easily a few megabytes.
As an old guy who is out of touch with software development, I have the impression that there are way too many layers these days. At some point, that will start doing damage instead of being beneficial. As I encounter more and more websites that do not work correctly, I sometimes ponder about it. Did we go a bridge too far already?
Nah, probably just old.
The answer is yes, but...
All the techbros invested in More Compute (speed/size) as the path to AGI are idiots. Human deliberative consciousness and the human adaptive unconscious were not some inevitable, magical outcome of making neurons fire faster and brain volume larger. Quite the opposite cause-effect. The human mind isn't about the speed/size of the hardware, but about the complexity of the software that runs on that hardware. That is, consciousness IS the layers, or more precisely, a temporary emergent state coaxed out of the layers.
The billionaires can convert the entire planet's surface into Compute with our current software, and we still won't have AGI.
AGI, if it ever arrives, will happen not because some Nobel physicist or engineer master-planned a silicon brain. It will happen because of trillions of actions taken by in-the-trenches hackers who collectively recapitulate exactly what Natural Selection did --
desperately throw together a crappy kludge solution to today's problems,
which arose from the desperate kludge a different dev threw together yesterday to solve yesterday's problems,
which arose from the desperate kludge a different dev threw together yesterday to solve yesterday's problems,
which arose from the desperate kludge a different dev threw together yesterday to solve yesterday's problems....
Stasis itself is not static.
Your mind and my mind are the reverberations of a clump of cells running flailing around as furiously as they can to stumble onto behaviors that allowed them to stay one step ahead of the Halt and Catch Fire state. Your mind isn't a beautiful unique little piece of the Universal Spirit coming to know itself. Your mind is a neurotic layer of recursive kludges terrified of letting itself conclude that it is, in fact, just Kludgeception all the way down.
There are exactly zero human minds running flawless perfect cognition.
Perfect code is a lie.
So why do people expect AGI to arise from some perfectly-architected code?
You're right that our slapdash layer stacks are doing harm. Good. The entire human mind is what happens when a tangible physical body is repeatedly harmed by external stimuli, and then attempts to predict and thereby avoid that harm in the future. Your identity is merely a behavioral pattern composed of the Venn overlap of tens of thousands of harm-avoidance kludge subroutines. Your choices are merely the total vector sum of all the motives of all these kludges.
AGI will come from rotten sloppy contradictory code that acquires the capability not to be perfect, but to keep going despite being rotten and conflicted.
So, collectively, we are on the right track!