It's just really hard for them to write non-verbose code. I don't know if this is incentives from the providers to generate more tokens, but even with guidance on compact code, simple, etc, they just can't really do it right now.
It isn't that surprising that it works well, this problem is fairly well known and some simple heat equations would lead to the result, about which there is a lot of training data online.
Would tend do disagree. Debug is arguably the most important skill to have and nurture right now (and that allows you to keep a strong mental model), and LLMs are not yet that good at it
the AI inference workloads shown in the paper are extremely far from what is implied when one says "... computer for AI inference". No discussion of issues around the memory hierarchy and how the presented architecture solves those. No mention of transformers, except for a vague reference to energy-based models
One thing that is also truly unappreciated is most of us humans actually enjoy thinking, and people are trying to make llms strip us from a fundamental thing we enjoy doing. Look at all the people that enjoy solving problems for the sake of it