Having an M3 with 36 GByte I was under the assumption, that I can utilize like Qwen and similar models. It's quite easy to set up, you can use pi or hermes for CLI access, or "Continue" to use it in VS Code. You can choose between omlx, Ollama and even more to run the model itself. It's no rocket science, but the results are also not satisfying.
I use it occassionally for very easy tasks, fix typos or update meta data in blog posts. So yeah, it improves productivity. But coding-wise it's far away from Codex, Claude et al.
No! It's a common misunderstanding (imho) that software development is about "writing code" or knowing a programming language's syntax. It never was, it never will be. I experienced this misunderstanding:
I never studied CS or IT or anything related. All my skills are self taught, starting when I was a litle boy. When I was young, I had problems getting into this busines, because HR and recruiters where tasking me with "Write this <x> using this <y>". They wanted to see A grades from 6 years of a master in CS.
Well. I am not that guy that memorizes syntax or coding rules. My approach is very different - and so are many, I assume. And this is what software development is about: You get a problem and you find a way to solve it. At many stations in my professional career I was able to proof that. I "mastered" Pascal from the scratch, on the job. Same goes for VBA, Shell scripting, Python, PHP, JavaScript... you name it.
It may sound arrogant - but then you misunderstood what I am trying to say: The language, the syntax, the coding rules are just "tools" for me. I don't care what I use. I focus on the problem.
Isn't it the same as "Write this <x> using this <y>" you may ask? No. Because this expects a specific solution. Not saying this will not lead to a result. It just a very narrow view on the solution.
There are good software developers that can answer those questions "Write this <x> using this <y>". That's not the point. The point is: There are also great software developers who can't.
With AI you don't have to worry to memorize syntax or rules. You can focus on the problem solving process.
So, AI is changing how software will be created. It make it more efficient. And it changes how HR and recruites hopefully will look at this profession. It's not about A grades in a CS class.
I want to believe. A couple of weeks ago I fell into this "trap", they offered a similar thing. I subscribed to the Pro Plan. Had fun for a couple of weeks and then I entered frustration phase. I love the product, but I hate those up and downs. My rant made it to HN front page - which I am not happy of. I want the stuff I build to be seen on the front page.
I can't believe that domain trading is still a thing.. I am sitting on a bunch of "nice" domains; I could never imagine someone actually bought for not even vor 100 bucks... and here we are, 30k?
I like the clean style, I was working on something similar, but never reached that readines-level.
However, the first screen seems a little contra productive. User entered a paragraph and in return gets a "summary" - but it feels so long. It's probably okay... it just triggered me very first impulse.
And what remains unclear is the meaning of "Team Sync". What's happening there? Is it a "group chat" or does it sends messages?
Speaking of... what about integrations with like Teams, Slack, Discord? I know that Teams offers a Meeting Summary which would be great if you could directly store it in _sig_.
I am trying Qwen3.5-9B-Claude-4.6 since a couple of days now locally coming from OMLX. Either via Hermes or Continue in VS Code. It's oka'ish, even performance-wise.
That's what I am thinking, too. It sound's like a conspiracy theory, but at the end Anthropic et al benefits from models that don't finish their jobs. I recently read about this "over editing phenomenon". The machine is never done. It doesn't want to.
It's like dating apps. They don't want you to find a good match, because then you cancel the subscription.
Not disagreeing per se, but a quick look at the installation instructions confirms what I assumed:
Yeah, you can run a highly quantized version on your 2020 Nvidia GPU. But:
- When inferencing, it occupies your "whole machine.". At least you have a modern interactive heating feature in your flat.
- You need to follow eleven-thousand nerdy steps to get it running; my mum is really looking forward to that.
- Not to mention the pain you went through installing Nvidia drivers; nothing my mum will ever manage in the near future.
... and all this to get something that merely competes with Haiku.
Don't get me wrong - I am exaggerating, I know. It's important to have competition and the opportunity to run "AI" on your own metal. But this reminds me of the early days of smartphones and my old XDA Neo. Sure, it was damn smart, and I remember all those jealous faces because of my "device from the future." But oh boy, it was also a PITA maintaining it.
Here we are now. Running AI locally is a sneak peek into the future. But as long as you need a CS degree and hardware worth a small car to achieve reasonable results, it's far from mainstream. Therefore, "consumer-grade hardware" sounds like a euphemism here.
I like how we nerds are living in our buble celebrating this stuff while 99% of mankind still doomscroll through facebook and laughing at (now AI generated) brain rot.
(I just wrote an extensive analysis about that https://nickyreinert.de/2026/2026-05-28-google-maps-reviews/