I'm getting into music production using an all-digital FOSS toolchain with only a Suno subscription and some second-hand Midi Controller hardware as the proprietary stuff. I use Suno as a source of inspiration and foundations for own tracks. What newest 5.5 model of Suno puts out, even in written and sung lyrics, is absolutely impressive. Media production is a field that's being turned on its head by generative AI and the most impressive case for that is about 80% of stuff Suno has put out for me in the last 10 weeks. If there is anything sustainable about how Suno is doing its thing, entire production pipelines in the music industry can basically get ready to shut down. I've seen sound engineers turn speechless listening to what Suno does with their raw material in less than 5 minutes for a process that would take some pro an entire week and even then not quite reach the level of quality.

Given that every cord and cadence has been played and (re)discovered probably hundreds or even thousands of times I wonder if anyone has a case against their AI or could argue that Suno is not original in the same way humans are. But other than that, as of today modern digital music production has basically ceased to be a job IMHO.

Yeah, there's two main problems:

1) People entering the wrong fields. For example, medicine really needs workers, at all levels, but not enough people are going into it.

2) Certain manual labour fields, like field work and home construction, because... well, I think we all know why there's a shortage of workers in those fields.

Is that a problem? It feels uncomfortable, sure. But what's the legal take here?

... to begin with. Why I don't quite get is that many people seem to be unaware of how quickly LLMs will be optimized to run on quasi-regular hardware, not needing the insane datacenters primarly used for training. AI _is_ a revolutionary tech, no doubt, but there also is a bubble that likely is about to pop.

Or let's put this another way. Show of hands - how many of you "spicy autocorrect" / "stochastic parrot" people had "AI will start mass-solving Erdos problems" on your forecast list a couple years back? Huh, none of you? Fascinating!

Take some time to reassess your priors. And while you do so, understand that, yes, they are doing logic / reasoning.

They weren't discovered by an LLM. They were known conjectures that were proven by an automated solving language that was linked to an LLM.

I'll take "Things That Didn't Happen For $200", Alex.

Only a handful of meaningful proofs have ever been done by automated formal theorem solvers (the Four Colour Theorem being the most noteworthy example - but its proof is so long that humans can't verify it). By contrast, AI tools have been solving Erdos problems en masse. The majority of them just bog-standard commercial models. In case you need help, the only ones on that list that were hybrid (AI / non-AI) in the actual solving phase are:

1) AlphaProof / DeepMind Prover Agent / AlphaProof Nexus
2) Aristotle (Harmonic)
3) Seed Prover / Seed Prover 1.5 (ByteDance)
4) AxiomProver (Axiom Math)

In each of the above, LLMs come up with the lemmas / strategies but then use Monte Carlo search ("brute force") or likewise to investigate what they came up with. These are a minority. In the "AI Standalone" category, these "hybrid" tools made up only ~20% of attempts and successful proofs. Hybrid tools actually made more of a contribution in the "AI Alongside Literature" (related literature found afterward) and even more of the "AI Building On Literature" (related literature known beforehand) categories, which is the opposite of what people like you expect.

And even with the hybrid tools, it's still the AI doing the heavy lifting when it comes to strategy. Non-AI theorem solvers, again, don't have a spectacular record for churning out novel proofs to unsolved problems. Tools like Lean are more about mathematical rigour - a passive environment that requires a driver (a human or AI) to feed it actual strategies, lemmas, and proof steps. And no, you cannot brute force "strategy" in the vast majority of cases, which is, again, why automated theorem solvers don't have much of a track record with unsolved mathematical problems.

Let's take a random example: the disproof of the unit distance conjecture. It was solved purely by a general purpose commercial GPT model, not custom-trained to mathematics, with no external tools. Read what the various mathematicians reviewing / commenting on it have to say (sections #3 and onward). Seriously, don't skip reading them, actually read them. This was one of Erdos's favourite problems. He mentioned it commonly in his lectures. Essentially every mathematician working in complex geometry has thought about this problem. The approach that the model came up with was highly novel approach, based on CM-fields and class field towers.

I know you don't want to accept this reality, but it is the reality, so you better improve your ability to accept it,. The field of mathematics is already doing so.

Dang, link didn't post.

Ah, good 'ol "Model Collapse" theory that people have been pounding on for years now, predicting an imminent collapse in model capabilities. How has that been working out for you?

Except what the US is actually facing, at least in the near term, is just the opposite, a worker shortage.

You can't pay royalties to the entire internet. That's not realistic.

What is practical are things like taxes to fund public benefits, or requirements of returning things to the commons (for example, open models).

... is what I suspect. If AI has the impact many predict, people will have to rely on their social security network for a while, but given the AI productivity boost things will get way cheaper too. There will be chaos and more pain than necessary for country with a sub-par wealth distribution, but by and large I am somewhat optimistic about the AI shakeup.

If all goes as it should we'll all simply be working less in 10 years time. To be honest, I already am. AI has cut my workload and increased my productivity even further to more than compensate for me calling it a day an hour earlier than just a year ago.

You're the one making the claim that modern frontier models still make this mistake (they don't), so how about you go to a frontier model, reproduce what you're claiming happens, and click the "share" button and post the link here?

Don't worry, I'll wait.

Your inability to reproduce the thing that you claim happens is duly noted.

You are speaking irrelevant nonsense. LLMs are trained in words

They are not. They are trained in tokens. Tokens do not align with word boundaries, and an arbitrary word can be tokenized in many different ways.

and they think in words

They do not. They don't even think in tokens. The process is: words are split to tokens, tokens point to an embedding position (latent space) while RoPE encodes a relative position, and all reasoning is done within latent space, which is not at all verbal (concepts are directions in latent space, and math is done on concepts, not words).

Also, a note: when spec'ing a generator, you need to know how much you're planning to use it vs. batteries. If it's only going to be used rarely, you prefer low mass, low volume, low cost, and low maintenance when unused (at the cost of low efficiency and higher maintenance in use), whereas if it's going to be used a lot, you prefer high efficiency and low maintenance cost in use, even if at the cost of higher mass, volume, cost, and maintenance when unused. In the former case, you'd prefer to allocate that extra mass, volume, and money into a larger battery pack.