> I didn’t add any frontier-tier models like Opus 4.7, GPT-5.5, or Gemini Ultra. At their prices, 30 games would have cost around $3,000 instead of $482.
I have a lot of thoughts unrelated to the game experiment but more about how these opus/ultra size models can possibly be a financially viable product at scale when it costs $3000 to play 30 simple games. It just seems much much higher than what it would cost to get a human to play 30 rounds
I started to look into the same thing considering releases are quite infrequent. To avoid the issue of unattributed LLM-authored commits, in my opinion the analysis should include a comparison to bug severity before and after release v3.3.0 (date April 6th, 2024)
> I used to want to do many things. Make great art, build great machines, solve important issues. Maybe our greatest gift to the world is to do as little as possible. To look at the birds, feel the wind and the water in our own hands, and ... nothing more. Eat when we are hungry, laugh when we are happy, cry when we are empty. And maybe that is the greatest gift to ourselves as well.
This is not always true, it depends on who you are. If you are an employee at Meta, or work for Philip Morris, you'd certainly do more good for the world by doing almost nothing, staying home doing nothing would be more moral compared to going to work everyday. Not so for doctors, nurses, teachers, and many other professions.
These are the same complaints I had. Also felt like it was high quality ai writing, possibly because of the style choices like "Benign overfitting is noise sitting in the reservoir at interpolation. XYZ is ..." and because of the similarity it has to the times I ended up with chatgpt or gemini creating very detailed and plausible reports about my own crackpot or vague-enough-to-be-useless ideas.
I have a lot of thoughts unrelated to the game experiment but more about how these opus/ultra size models can possibly be a financially viable product at scale when it costs $3000 to play 30 simple games. It just seems much much higher than what it would cost to get a human to play 30 rounds