Wondering whether they are more worried about security concerns given the latest model releases (see European Central Bank about Mythos) or a potential bubble and how/if they can do something about it
I feel like 12 months ago it was just about "we just need the next great model" and now we are seeing how there is a lot of infra to be built around these models to avoid ROI negative tokenmaxing outcomes
Yeah totally feel you on this one! To avoid it or at least limit that I usually ask it to create external memories, clearing the context window and leaving just a trace to recall the memory created for that run. I hope it might help!
I was reading a bit about their story, it feels like they managed to succeed by turning overly funded (and by then devalued) software products and restructuring them for long term profitability as they are not bounded to the classic 10 year time horizon of private funds. Wondering if we will see more plays like this as alternatives to traditional private equity and as fallback option for VC backed companies that bursted.
Genuinely experiencing it daily and tackling it by having a few audit agents running in parallel to keep the big picture and feed context as needed. However, this is terribly expensive.
My question tho is, how confident are we about an agentic future? I mean coding was the one thing agents "are best at". How would you run a complex system/organization on an agent where they will need to face with a massive (and growing) context through a limited context window?
How is this sustainable in the long run tho? Major enterprises are already making the headlines as they cut licenses and reduce token consumptions. The conversation is moving a lot toward return on token... is automating this activity with an agent giving me a higher return rather than having a human run it? Plus the advent of local AI and open source models are creating new opportunities to reduce token costs
Wondering if it's just the iphone and the fact that we have it always in our pockets or the amount of "radiations" we are exposed it constantly at home at the office tbh