LLM is a compiler, not a runtime(getpocketbot.com)
getpocketbot.com
LLM is a compiler, not a runtime
https://getpocketbot.com/blog/llm-compiler-not-runtime
1 comments
Working with Anton on the implementation side. The biggest unlock wasn't cost, imo it was swapping mysterious non-reproducible inference bugs for boring, reproducible compiler bugs. The emotional shift of "I can actually debug this" came before the cost savings did.