It's quite obvious that things are highly subsidized now. What will happen when subscriptions 10x in a year? That's that danger for the enterprise. I don't think the average enterprise will allow users to run local LLMs tbh. Just my POV feel free to tell me that I'm wrong!
If I was a lawyer I would worry about auto note takers too. So easy to view something out of context as something totally different from what actually happened. Just my 2 cents
Gemma4 is a huge improvement and it's fast. Qwen 3.5 really slows down my machine though. LMK if there is a better model to use for the code assist aspect- performance wise
Relying on external APIs network failure points and unavoidable latency from the round trips. There is also the AI API rate limits that come into play. We might find that for critical workflows, local compute is the only reliable architecture.
@noashavit on LI, X, and Github.