I don’t know if I’d club fast food restaurants into the dopamine factory category. I see it as more of a necessity as I don’t think I can go hunt or gather food during my lunch break at the office.
It’s not just about the model but also setting up the system to create and share compute (GPUs) which is quite complicated on its own. Ubers primary business focus isn’t infrastructure.
Like everything there’s always a balance. Sometimes building something and seeing how it works might have a higher cost to “correct” once built. Other times, it’s much faster to build.
Really fun read. To be this seems awful close to my experience using these models to code. When the prompts are simple and direct to follow the models do really good. Once the context overflows and you repopulate it, they start to hallucinate and it becomes very hard to bring them back from that.
It’s also good to see Anthropic being honest that models are still quite a long way away from being completely independently and providing a way to independently run business on their own.