This seems pretty useful for AI inference if it can pass Apple approval. I've wanted to use my Nvidia GPUs with a Mac Mini, this would enable it to run CUDA directly. Very cool!
In fact it is appreciated that Qwen is comparing to a peer. I myself and several eng I know are trying GLM. It's legit. Definitely not the same as Codex or Opus, but cheaper and "good enough". I basically ask GLM to solve a program, walk away 10-15 minutes, and the problem is solved.
Hmm you might be able to tweak the settings further. Under llama.cpp on one RTX 6000 Pro I get ~215 tok/s generation speed. The key for me was setting min_p greater than 0. My settings:
I have not delved into the theory yet but it seems that the smaller open-source models do this already to an extent. They have less parameters, but spend much more time/tokens reasoning, as a way to close the performance gap. If you look at "tokens per problem" on https://swe-rebench.com/ it seems to be the case at least.
I gave it a whirl but was unenthused. I'll try it again, but so far have not really enjoyed any of the nvidia models, though they are best in class for execution speed.
120B would be great to have if you have it stashed away somewhere. GPT-OSS-120B still stands as one of the best (and fastest) open-weights models out there. A direct competitor in the same size range would be awesome. The closest recent release was Qwen3.5-122B-A10B.
The good news is local models have significantly improved. If it all goes down today, you can still run e.g. Qwen 3.5 at home, and it's "good enough" for most workloads.
With a gaming GPU you can run Qwen3.5-35B-A3B. I use 122B-A10B on my local rig (1x6000 Pro), and 397B-A17B on my 2x6000 Pro server (some spillover into CPU/RAM). It's pricey now but probably within a few years it'll become very affordable.
We all probably need to touch grass a bit. Our industry is really out of touch with reality right now, although the looming impact of AI is probably quite real.
It does? There is a fast drop followed by a long decay, exponential in fact. The cooling rate is proportional to the temperature difference, so the drop is sharpest at the very beginning when the object is hottest.
Is there interest in benchmarking the proprietary LLMs for translation? Curious as I often use Gemini 3 Flash, but I have no idea how good it is for my language family. I prefer open models (in fact the smaller the better for offline), but it'd be useful to know how well the Big Three do.
Even working in "tech" but not FAANG this is so true, 10 days is still the norm at many white collar businesses for your first year of employment, sometimes 15 days if they're generous.
The tradeoff with many EU countries would be that they enjoy their leisure time a lot more and sooner than Americans. Americans make more and save more statistically, but they spend it on cars, houses, and medical care, and generally have way less free time. So I think it's a wash.
As someone studying Polish, and making excellent progress, I mostly agree with your take. If you want to explore other languages, something like Spanish will get you much more mileage. Polish is difficult and the community of speakers isn't exactly warm to foreigners or people acquiring the language. On the other hand, if you truly enjoy languages and are passionate about them, I have found Polish to be really interesting and beautiful in its own way. Definitely not recommended, but still enjoyable to read/write/speak.