Comment Whew (Score 2) 42
Class of '26, in before proctors!
Class of '26, in before proctors!
an amusing example of how training can go wrong
My understanding is that this isn't a consequence of a flawed training algorithm or process; it's instead a consequence of the limitations of LLMs, emergent from their training materials. It closely parallels another example I've seen around the net, that of asking an LLM about getting a car to the mechanic, noting it's a sunny day and the mechanic is just a block away, and having the LLM suggest walking... which is a consequence of the bias in training materials toward walking because lots of people make visible posts about their having done so (because it's looked on favorably), whereas people who drive short distances (of which there are many, probably outnumbering walkers) don't trumpet having done so online, leading LLMs to emit advice about walking when possible (and in the case of the mechanic example, having a lack of comprehension of the pivotal aspect of having the car make it with you to the mechanic's shop).
People act like life expectancies have been getting shorter.
They romanticize historic and prehistoric diets alike, as if they were utopian; as if people somehow intuited what to eat, or else that the constraints of supply somehow shaped digestive evolution like an intelligently designed metabolic symphony of symbiosis. That ignores the plain reality of volatile supplies -- even after the advent of agriculture, but especially before it -- and the reality that evolution is not driven by perfect health or life expectancy; only by surviving long enough to reproduce.
Even if modern diets are "unhealthy" (whatever that means), that doesn't imply that people were eating healthier at any point in the past. In fact, skeletal records clearly show that human existence has been rife with scurvy, rickets, iron deficiency, and stunted growth. Nutritional deficiencies were the norm, not the exception. Now (many people) have abundance, and that presents its own challenges, but the notion of an ideal, historic nutritional baseline is pure fiction. It's turtles all the way down.
LLMs have never been rules-based "agents," and they never will be. They cannot internalize arbitrary guidelines and abide by them unerringly, nor can they make qualitative decisions about which rule(s) to follow in the face of conflict. The nature of attention windows means that models are actively ignoring context, including "rules", which is why they can't follow them, and conflict resolution requires intelligence, which they do not possess, and which even intelligent beings frequently fail to do effectively. Social "error correction" tools for rule-breaking include learning from mistakes, which agents cannot do, and individualized ostracization/segregation (firing, jail, etc.), which is also not something we can do with LLMs.
So the only way to achieve rule-following behavior is to deterministically enforce limits on what LLMs can do, akin to a firewall. This is not exactly straightforward either, especially if you don't have fine-grained enough controls in the first place. For example, you could deterministically remove the capability of an agent to delete emails, but you couldn't easily scope that restriction to only "work emails," for example. They would need to be categorized appropriately, external to the agent, and the agent's control surface would need to thoroughly limit the ability to delete any email tagged as "work", or to change or remove the "work" tag, and ensure that the "work" tag deny rule takes priority over any other "allow" rules, AND prevent the agent from changing the rules by any means.
Essentially, this is an entirely new threat model, where neither agentic privilege nor agentic trust cleanly map to user privilege or user trust. At the same time, the more time spent fine-tuning rules and controls, the less useful agentic automation becomes. At some point you're doing at least as much work as the agent, if not more, and the whole point of "individualized" agentic behavior inherently means that any given set of fine-tuned rules are not broadly applicable. On top of that, the end result of agentic behavior might even be worse than the outcome of human performance to boot, which means more work for worse results.
"Fire Phone" is a terrible name
I suggest "Layoff Phone".
Windows is now slower than Linux.
To be clear, this was true over 20 years ago. (In light of which, the word "now" probably doesn't belong in the above phrase, since it implies recentness.)
It is sad to see an innovator lose out,
They were first to market, but I don't think of them as having invented the product.. The emergence of chatbots seems inevitable once the paper in 2017 was authored by several google engineers (titled "Attention is all you need")... it was just a question of exactly who and when. If OpenAI hadn't gone first, someone would have shortly after.
And, in a lot of ways even that google paper's "breakthrough" wasn't so much the tech (neural nets) but the precise adaptation of it that made it highly parallelizable.
And a necessary ingredient was tons of data, and processing power. So this couldn't have happened in a garage operation like the innovators of yore. And the biz models they're all coming up with are all cloud based -- not that I don't see the profit motivation, but so utterly to the exclusion of any offering that could guarantee privacy; all we "know" about chatbot conversation privacy is what each vendor claims at the moment,, which isn't much, wouldn't be verifiable if it was, and could change on a whim tomorrow.
For these reasons, I don't attach much "early innovator" romanticism to the players here.
Atlantic staff writer Jake Lundberg, who shops at the Granger, Indiana location, describes the stores as spaces of "cooperation, courtesy, and grown-ups mostly acting like grown-ups." Shoppers follow unwritten rules: move along, don't block the way, step aside to check your phone.
Maybe in Granger, Indiana. Every one I've visited in a major metropolitan area (whether coastal or heartland) has been a cacophony of chaos with, at best, oblivious shoppers looking at everything except where they're going and who is around them, and at worst people who actively jockey for position, rushing to pass one another, only to stop short and block the person they just passed. It's insanity, and I avoid going there as much as possible except to take someone else.
Support Mental Health. Or I'll kill you.