i think its more efficient for models to write queries than read large(ish) documents. at some point you have to have a tradeoff - smaller docs, but the model has to find them (thats a query) or larger docs, and the model has to read them.
My take is AI native apps that have longevity will prioritize token-efficiency - and I believe queries do that.
Theres tons of ai apps. They're all general use chatbots or coding agents. Manus, Cursor, ChatGPT. Almost every app that has a robust search uses a reranker llm. AI is everywhere.
As far as totally new products - I built one (Habit.am - wordless journaling for mental health) and new products require new habits, people trying new things, its not that easy to change people's behavior. It would be much easier for me to sell my little app if it was a literal plain old journal.
I ran tests of 100 attempts with different prompt/scenario combinations. Each "attempt"/theory had 3 different system prompts wordings. Most of the prompts did not mention a colon, but it kept appearing. When I added negative instructions against using a colon, the quality went down (most of the tool calls were malformed, one common issue was markdown ticks in front)
It was only when my system prompt acted like colons were normal that I kept getting 100/100 perfect expected tool calls. I ranked my system prompts by which returned the most consistent commands.
I tried over 20 variations of different system prompts.
Once I changed my tool to expect the colon, it also felt like it was running/calling tools faster, but I need to do a larger test to be sure.
I agree. Kimi K2.5 is basically a clone. But also GPT 5.4 has replaced Opus for me. I have unlimited access to all of the proprietary models so I really only make the choice based on convenience.
I must be alone in this but I don't think its heavily subsidized. I see their models as really overpriced. No way they cost that much. Could they really?
Dario has stated multiple times he doesn't believe there is any value in open-weight models. Not surprised. This is not the behavior of an innovative company - it is fear-driven. They are seeing a rapidly shrinking moat.
I canceled my family subscription last month. We have Youtube Premium which I use to play music - Spotify was over 20/month and no longer made sense. We mostly used it to play music on our Google speakers for the kids. It's one of those products that used to make sense, but now just doesn't feel so critical. It's easy to replace and patch where I used it.