As a Canadian I think this is a very stupid idea for many reasons, but the general dismissive attitude of LLM technology here on Slashdot is shocking though not surprising. Since the start of my career in IT 25 years ago I noticed this intense cynicism of new technology from those in the field. They’ve lost all excitement and imagination for things except perhaps some personal niche interests. Some of it is earned of course, we’ve all seen vapourware and snake oil, but the instinctive behaviour is to shit on and dismiss everything. Calling today’s advanced LLMs “sentence generators” is perhaps the perfect example of this stupidity. Yeah, they generate sentences, and we all know how they function (hopefully) and their limitations, but this view of the technology is pure idiotic garbage.
We’ve figured out how to get a computer to converse with humans in natural language for fucks same. That is amazing. This was a holy grail problem in computer science just a few years ago. You know we invented programming languages, and all concise input devices (mice, keyboards, etc) just to bridge this gap? Yes LLMs don’t yet replace the specificity of those, but I for one have been BLOWN AWAY by the advancement in this field. I studied NLP in univ and since GPT v1 dropped I’ve been astounded at just what these systems are able to do. Yes it was easy to trip them up and identify shortcomings, but the relentless focus on just that is stupidity.
LLMs through their training ingestion are brilliant repositories of a vast amount of human knowledge and ideas, and we can now query those in our own language, and receive responses in a nuanced and “insightful” way. It is not sentence generation or regurgitation. It is undeniable to me I can craft questions where it puts together words and concepts in a unique and “creative” way. The fact it is a (debatably) deterministic computer program and current power issues are irrelevant. We’ve clearly cracked a brilliant understanding of how words and sentences relate to concepts and ideas (all it takes is attention right?) and I’ve constantly found the potential applications of this to be profound in a good way.
I’m actually not a heavy LLM user, but I hit it up for interest sake when I’m grinding my brain on something, and it’s getting more frequent. Just in the last short while, I had it deeply analyze my thoughts on our network operations and specific strategies and steps for improvement (admittedly not exciting). I also had a deep conversation about my 20 years journey learning to play guitar and my specific struggles and frustrations. The answers blew me away and and are immediately making me better. Nothing short of a game changer. Calling that a sentence generator.. sorry bud your mind is just spare parts. Societies that take advantage of LLMs will be smarter, more insightful, better trained, more creative, and far more powerful than those who do not.