The recent breakthrough of llm’s solving major open problem’s in math is a direct contradiction to the article.
But, there is some truth to the article and perhaps it is more true in chat based interactions. The agentic, hands-off mode might tell a different story.
Nice find! The final paragraph of the Conclusion is amazingly prescient!
"Significantly, we found that translation quality as
indicated by BLEU score continues to improve with
increasing language model size, at even the largest
sizes considered. This finding underscores the value
of being able to train and apply very large language
models, and suggests that further performance gains
may be had by pursuing this direction further."
You should read that essay! The model is capable of producing phd level research on it's own with minimal set of prompt's. I was sad because of this paragraph:
"That view is that there is still a great deal of value in struggling with a mathematics problem, but that the era where you could enjoy the thrill of having your name forever associated with a particular theorem or definition may well be close to its end. So if your aim in doing mathematics is to achieve some kind of immortality, so to speak, then you should understand that that won’t necessarily be possible for much longer — not just for you, but for anybody."
He may seem to imply the end is only for some subset of reasons but if you read the entire essay he is just trying to give hope where the rest of the essay is really damning!
I am glad to see this today - after reading Tim gower's recent post on chatgpt 5.5 pro's phd level research ability I was feeling slightly sad about the future of math research.
Interestingly enough, the moment I saw the title I thought of Bill Thurston's famous article "On proof and progress in mathematics" and the top comment on the OP's thread is from him! Reading his reply sort of gave me the antidote to the temporary blues I felt yesterday.
.claude has become the new dotfiles. And what do people do when they want to start using dotfiles ? they copy other’s dotfiles and same is happening here :)
But, there is some truth to the article and perhaps it is more true in chat based interactions. The agentic, hands-off mode might tell a different story.