I really appreciate this type of articles. I feel like a lot of knowledge in LLM training and inference is locked inside the heads of practitioners. Similar to compiler engineers before.
To work in LLM training/inference you’re expected to know this stuff but to know this stuff you need to be working in the space.
As someone with a bit of interest in programming languages (design and implementation) this was really interesting to me:
> For most people who work on programming languages, the easy part is coming up with new and better ideas about how to make programming better. The hard part is convincing anyone to actually use those ideas for real work.
Totally agree, there's only so much strangeness you can introduce in a new language[1] regardless of benefit.
But AI agents should not feel much resistance to radically new ideas in PL design. I've been thinking for a while now about how PL design will evolve post agentic AI. I think it will be very interesting to see what new ideas we can come up with to improve programming languages when we worry much less about adoption.
Thanks for the kind words! Even though this is definitely meant for desktop screens, I really didn't want it to fall apart on mobile. As for upvotes, it's super niche so I wasn't really expecting even a single one tbh
As I understand Peter had already early retired because of a successful startup exit and presumably has more money than he knows what to do with. Does that help make you feel less jealous on him getting a job at oai?
To work in LLM training/inference you’re expected to know this stuff but to know this stuff you need to be working in the space.