Software engineers are definitely in a bit of a bubble here. Are we just early adopters who see the value sooner, or does it uniquely benefit software engineering, or do we just like cool automation and we're deluding ourselves that this adds value beyond the cost?
Yeah I mean this is closer to my use of LLMs, where I'm intentionally slowing things down enough to follow and course correct myself. This whole build the loop not the prompt idea seems to be advocating the opposite... I don't feel comfortable to not be the driver of the loop for a production system.
I'm just struggling with this, surely you need inner depth knowledge to reason about the system and make some level of decision, at least around system design and architecture if not lower level implementation details? But it sounds like you're generating that knowledge each time through a system of agents? How do you have so much trust in a non-deterministic system, or are you deferring ALL decisions to these "loops"? What if you and a team member generate a dashboard and it gives different results because the agent(s) used a different methodology?
And surely cost plays a part here. This is giving you such productivity gains to boost revenue enough to outweigh what must be huge token costs?