what kind of behavior would demonstrate that LLMs did have understanding?

An LLM would need to act like an understander -- the essence of the Turing Test. Exactly what that means is a complex question. And it's a necessary but not sufficient condition. But we can easily provide counterexamples where the LLM is clearly not an understander. Like this from the paper:

When prompted with the CoT prefix, the modern LLM Gemini responded: âoeThe United States was established in 1776. 1776 is divisible by 4, but itâ(TM)s not a century year, so itâ(TM)s a leap year. Therefore, the day the US was established was in a normal year.â This response exemplifies a concerning pattern: the model correctly recites the leap year rule and articulates intermediate reasoning steps, yet produces a logically inconsistent conclusion (i.e., asserting 1776 is both a leap year and a normal year).

First they came for Boeing, and I didn't say anything because I wasn't all fucked up.

Got to be pretty unconventional to count as unconventional in QM.

Being a hippie never goes out of style.

Not everyone has enough money to do groundbreaking things like put a car in orbit.

I saw it when it came out, and thought it sucked donkey doodles.

Don't they know fake news is what everyone wants these days?

Perhaps I'm being too harsh. For example, if their boss is an MBA who gives out raises on the basis of how many pounds+gallons they produce or sell, they would be quite rational to request a report that shows how many pounds+gallons they have produced or sold.

For some suitable definition of "work".

In my experience, business "analysts" don't know what the hell they want, let alone how to specify it.

I've been asked to create reports that add pounds + gallons, and it's almost impossible to get them to understand why that's nonsense.

Why not? People who think their god will protect them don't need foxholes. People in foxholes are putting their trust in the boring but well-established ability of a thick pile of dirt to stop bullets.

I've been wondering what the authorities would do if I started selling updated accommodations for the afterlife. Want an extra garage or bath? Something closer to the golden throne, or further from all that off-key singing? Or most popular of all, something farther from those people.

Pay now and get it later, of course.

At least he wasn't puttering the choir boys.

when you need him?

Buy my stock.