Comment Keep it local (Score 1) 23
Many Google products run AI features on-device. This isn't sustainable, Google says, as advancing AI tools need more reasoning and computational power than devices can supply.
I say that's BS and it's just a matter of will, greed, and control. Number one, models can be quantized, made in lower FP precision, and can even work in integer form instead of FP. Number two, models with many more parameters often don't produce results that are commensurate with the difference in the number of parameters between them and models with fewer parameters. But more importantly, I'm tired of the hegemony, gatekeeping and control of tech companies keeping AI service locked up in the cloud. After playing around with visual gen ai systems in ComfyUI both locally and in the cloud and getting similar results and performance in both, I've come to the conclusion that we're being treated like serfs and the industry-especially Nvidia and RAM manufacturers-are pushing a cloud-only system despite running locally being totally viable. I'm tired of Apple and others treating RAM and storage like it's water or gasoline in a Mad Max post-apocalyptic world, giving us the bare minimum and charging and arm and a leg for more. I feel like we're experiencing the PC revolution-especially the desktop publishing and desktop graphics/art/illustration revolution-in reverse. Instead of democratizing the power and giving it everyone, it's being withheld and concentrated in just a handful of big tech companies. I'd rather make it more like the PC revolution that we had and perhaps even better, make really, in line with the principles of people like Richard Stallman and the principles of movements and organizations such as the FSF.