Ask HN: Is the window for local-first AI closing?
3 comments
Not sure where you're looking, but you have companies like Minstral releasing Ministral 3 models for edge compute. Works fine on gaming PCs.
Edit: I doubt the "defaults" companies ship are going to matter much. We see what's happening with Microsoft and I've not met anyone that's happy with how LLMs are being shoveled into every digital product possible. Seriously, Microsoft doesn't need Copilot in their OS, they need to fix their stupid start menu decisions first.
Edit: I doubt the "defaults" companies ship are going to matter much. We see what's happening with Microsoft and I've not met anyone that's happy with how LLMs are being shoveled into every digital product possible. Seriously, Microsoft doesn't need Copilot in their OS, they need to fix their stupid start menu decisions first.
oh i agree on microsoft but google is shoving it everywhere as well and it will get more and more intrusive
The problem with local AI is that in the future Agents will be running 10s of simultaneous conversations.
The thesis isn't "local AI is better." It's that the window to build credible alternatives is closing. Apple, Google, Amazon are all watching local inference become viable. Their response will be "local" AI that phones home - on-device processing with cloud-mandatory features, privacy marketing with telemetry requirements.
Once those defaults ship, it doesn't matter if alternatives exist. Most people never look for options once something convenient is already there. Search, social, mobile, cloud - the pattern repeats.
The question I keep asking: does building local-first alternatives matter if they don't win market share? My current answer is yes - the existence of a credible exit changes how platforms behave, even if most users never take it.
But I'm also aware this could be cope. The self-hosting crowd has lost every major battle. Email, messaging, social - private options stayed niche every time. Maybe AI is different because the models are finally capable at small sizes. Maybe it isn't.
Building something in this space. Curious if others see the same window, or if I'm just rationalizing a preference into a market.