Forgot your password?
typodupeerror

Comment Re:Good (Score 1) 29

The business case for LLMs is a bit broader than that. They don't need to replace that many workers if they make enough workers more efficient or more reliable (such as simply having LLMs look over drafts). There's also at this point, clear usage cases for scientific and mathematical research but that's using the very high end models, and admittedly is a pretty small market, not enough to justify massive expenditure at this level. The tulip example is interesting; what you are touching on their is the distinction between a "tech bubble" (like railroads or internet) and a "commodities bubble" (tulips, housing, Beanie Babies). Note that the degree to which the tulip bubble was real is questionable. See https://theconversation.com/tulip-mania-the-classic-story-of-a-dutch-financial-bubble-is-mostly-wrong-91413, and the line between a tech bubble and a commodity bubble itself can be blurry (see for example Bitcoin and NFTs). One of the difficulties here is that the LLMs keep improving, and the cost per token is going down, and the amount one can do per a token is going up. But that's happening in part due to massive investment in both infrastructure and research. How sustainable any of that is is unclear.

Comment Re:Good (Score 5, Interesting) 29

Sooner or later people are going to realize that AI is just another name for Linear Algebra and all this will come crashing down

There are at least four problems with this. First, linear algebra is from a math standpoint insanely powerful. For example, all of representation theory https://en.wikipedia.org/wiki/Representation_theory is using linear algebra to understand groups. Much of the study of modular forms https://en.wikipedia.org/wiki/Modular_form involves understanding the behavior of modular forms over SL_2(Z) which has heavy linear algebra elements to it. People who see linear algebra as somehow a weak thing are often people who took a single semester of it and didn't do much else with it.

Second, the idea that these AI systems are just linear algebra isn't accurate anyhow. While there's a lot of linear involved, a major part of how transforms like LLMs work is the intervening non-linear layers, which use ReLu https://en.wikipedia.org/wiki/Rectified_linear_unit, Softplus, or a similar function. So, summarizing this as just linear algebra isn't accurate. It is linear algebra with some spice.

Third, even if this were somehow just linear algebra, that shouldn't therefore be a reason to think that there's any limits to what is going on. At the end of the day, the empirical success is what matter, and systems which can do things like prove the quasi-Riemann Hypothesis or solve other major math problems are pretty impressive regardless of what is under the hood. So, if one does think this is just linear algebra, that's not a reason to dismiss the systems but a reason to increase your estimate of what can be done with mere linear algebra.

Fourth, slowing down connections like this may make crashes *less likely.* In particular, the main way we could have a serious bubble here is over-investment. Delays including power grid delays force bottlenecks on the investment level, and make that sort of problem less likely.

We may be in a bubble here. Certainly some elements look very bubble-like. In the late 1990s, during the dot-com boom, one had people making perfectly normal businesses but just tacking on "on the internet" to it and it would get millions of dollars of funding automatically. See for example pets.com . And we're seeing some of that now; we've had a whole bunch of businesses see their stock price shootup just because they mention AI. So we may be in a bubble, and it may crash now, or might crash never or decades from now. (Arguably the US had an 80 year automobile bubble that didn't crash until the late 2000s which then forced the auto bailout.) But the other thing to keep in mind is that a crash does not mean the tech goes away. In 1873, the US had a devastating collapse of the railroad bubble, and yet railroads continued to grow, with the amount of track not peaking until around 1910 https://transportgeography.org/contents/chapter5/rail-transportation-pipelines/rail-track-mileage-united-states/. Similarly, although the internet bubble burst, by 2015, one had more internet use than even the most internet hyping person in 1998 would have likely dreamed of. A bubble bursting does not mean the tech itself goes away.

Comment Re:I smell plateau (Score 4, Informative) 58

In my experience the new Frontier LLM models are in no way as much of an advance over their predecessors as their predecessors were.

I don't know what field you are in, but in my area, math, this is wildly not the case. They are much, much better. And the next line of the public frontier models are obviously even better judging from everything that we've seen drop from OpenAI and Anthropic. The large OpenAI release would by itself would have four or five results which would arguably be a Fields Medal if a human had done that, and quasi-RH which would if a human did it be almost definitely a Fields Medal result.

Comment Re:mostly mash-ups of existing techniques (Score 2) 136

While this may be hard to understand for non-mathematicians, the data-theft angle could not be any more obvious.

On the contrary. The people trying to make this sort of claim at this point are overwhelmingly the non-mathematicians. To the mathematicians the number of new proofs of genuinely difficult problems and the use of novel techniques like those in the Unique Games Conjecture proof and Hadwiger-Nelson make us generally have the exact position you are claiming is something that is believed by the non-mathematicians. Even the most anti-AI mathematicians like Tasmin Chu agree that the AIs are producing novel, major work at this point.

Comment Re:mostly mash-ups of existing techniques (Score 2) 136

This gets to some extent into the issue of what we mean by "novel" and admittedly that has some subjectivity to it. One take on what is going on here is that this should be showing us how much that we thought of as creative was just rearranging things. There's a legitimate argument that the AI isn't doing anything creative or clever here, and that if someone says, "Well, by that metric the vast majority of human mathematicians aren't doing anything creative or clever," and while I see that as a pretty hard response, one response is to just say "Yeah, go bite that bullet."

Comment Re:A few comments on the problems (Score 2) 136

Thank you, may I ask did you use AI to draw your conclusions?

Here? None.

I am most interested where you say "the technique it uses here is not in the literature" , does this suggests novel creation or derivation?

I'm not sure where the line is there. For at least some of these, part of it seems to be the AI importing pieces of techniques used in other areas of math. In general, no human discovery is completely novel. Newton's work relied on prior work of Galileo, Oresme and many others. Einstein's work relied on ideas of hundreds before-hand. At the same time, there's people whose work really does look like it is fundamentally different in many ways than what went before, and both of those are examples. In math, Peter Scholze's perfectoids for example clearly build on existing ideas, but there's a lot of stuff that looks deeply new. How to draw the line here isn't always clear. For what it is worth, Harald Helfgott, who is a much smarter and more knowledgeable mathematician than I am thinks that of what he's looked at it seems like the AI is still producing things in what amounts to almost the "convex hull" of known math or close to it. But his idea of what that looks like may be much bigger than my idea.

Comment Re:How many more (Score 3, Interesting) 136

No one saw quasi-RH coming or many of the others here. So that is unlikely. And the last batch of 10 problems they released a few weeks ago which were impressive enough were all novel results. There have been issues with them using techniques or ideas that should be better credited to where some of those approaches are coming from. But that's the sort of thing that often happens at a preprint stage. When I referee a paper, if this happens, you just request they cite the relevant papers and move on. This isn't at all stealing things.

Comment Re:mostly mash-ups of existing techniques (Score 5, Interesting) 136

If the mathematicians ever used ChatGPT to talk about math, then that is the source of the results. LLMs, by definition, cannot usefully contribute to anything that requires more than rearranging existing data. Rearranging existing data is their only function.

This is really not accurate. There's Fields Medal level work here with quasi-RH for example. And for Hadwiger-Nelson it took an approach that doesn't seem to be in in the literature. These things really are doing novel math. I've personally seen this is in a bunch of situations. Here's a personal example, much smaller than anything like these problems. I have a recent preprint with a student here https://arxiv.org/abs/2609.36068 (about 90% of this was done by her. She's very good.) But part of this came from when I ran a version of Proposition 13 in that paper through Claude just to clean up the draft of that bit before I sent it to her. Claude informed me (essentially unprompted) that the argument had a whole in it (in addition to pointing out grammar errors, unbalanced parentheses and some other embarrassing minor mistakes). I then fixed the hole, and gave it back to Claude. Claude thought for a few minutes, and then informed me that I had *not* fixed the hole, and the reason was that my version of the proposition was missing an entire infinite family which it constructed. The literature on this problem is small, and I'm very familiar with it. The family it produced is straightforward (see Prop 8), but definitely was not in the existing literature. So yes, these systems really can do novel math, and can even do so in an essentially minimally prompted fashion, in this case, explaining to the meat mathematician why his proof is wrong. My student and I then generalized Claude's family to Theorem 9 in that paper, but the AI definitely had an impact.

At some level this was actually not a good thing. I'm trying to encourage students to *not* rely on the AI for research so they develop basic research skills. So if the AI had not volunteered the family I wouldn't have had to tell her that the AI had discovered it, but honestly required noting it. So I had a conflict between intellectual honesty and being a good role model.

Comment A few comments on the problems (Score 5, Informative) 136

Mathematician here specializing in number theory with a side-order of graph theory. I've only had time to start looking at two of them. First, is the Hadwiger-Nelson/chromatic number of the plane https://en.wikipedia.org/wiki/Hadwiger%E2%80%93Nelson_problem proof. As far as I'm aware (and I could be wrong) the technique it uses here is not in the literature, so this is a genuine construction of a new technique. Second is the Erdos Egyptian fraction bound, and for that one it looks like the techniques are about what I'd expect, but I'm definitely still digesting both of these.

For the quasi-Riemann Hypothesis the striking thing is almost the opposite direction. It looks like the AI used standard complex analytic techniques to get the result. But many mathematicians have often thought for years that those techniques would not likely be strong enough to get this sort of result.

I know less about the Unique Games Conjecture https://en.wikipedia.org/wiki/Unique_games_conjecture but having talked with some of the people there it looks like it took a somewhat standard set of ideas and then combined them with multiple just weird stuff and sort of took a hard left turn at one point for no clear reason and ended up at the result.

It is also worth noting that while many of these have Lean code confirming their correctness (quasi-RH for example) others do not. The three I mentioned above have all also been looked at at this point by human mathematicians who have not found issues; that's likely true for others, but those three I'm aware at least of people doing so. Not all the claims have Lean code though; a bit under half. One of the non-formalized problems also has been withdrawn due to what essentially amounts to a sign error https://github.com/openai/math/blob/main/preprints/Algebraicity-of-Weil-classes-on-split-abelian-eightfolds-September-18-2026/paper.pdf. It is likely others will be withdrawn also by the end, but I'd be surprised if more than 10 are. And even if everything single one without Lean code turned out to be wrong (which seems very unlikely), this would still be an amazing set of math. I commented elsewhere that if a human mathematician had made the quasi-RH result they'd be likely a shoe-in for the Fields Medal, and another mathematician replied saying "delete likely."

Now a more editorial comment: There are legitimate concerns about what this is doing to mathematics. This sort of thing is very cool. But it also is part of a trend that may make it much harder to train young mathematicians or get them to exist at all. If the AIs are limited in how genuinely novel their ideas can be, then we may end up in a situation where we get a massive burst in math over the next few years, and then math stalls out because we don't have enough good really high caliber mathematicians (Not the mathematicians like me, but people like Serre, Tao, Scholze, Clausen,etc.) to come up with deeply new ideas that the AIs can build on.

Comment Re:Just for clarity (Score 1) 87

Let's modify your analogy a bit. If someone has a recording a person starting to eat spaghetti, is it more or less likely that the recording will show them then having a drink of water? And if we instead had a series of comics of a person, and the first one says "I'm hungry," and the second shows the person ordering spaghetti., is it likely that they will then eat the spaghetti? Yes, even though they are fictional. Because apparently using fictional being's mental states is useful for modeling what they will do. In the same way, if the AI is modeling based on human emotional states, then recognizing that those are useful predictors for what will happen helps us predict more, whether or not they genuinely have those emotions.

Slashdot Top Deals

Money doesn't talk, it swears. -- Bob Dylan

Working...