Local Models in Mid-2026(coles.codes)

3 pointsby colescodes28 hari yang lalu3 comments

Local Models in Mid-2026

https://coles.codes/posts/local-models-mid-2026

4 comments

denn-gubsky27 hari yang lalu

Thank you for sharing. I'm running Gemma4:12b and qwen-coder-next MoE on my local RTX5080 (yes, 16Gb). Using them for local agentic tasks with tools and MCP tools usage. Both hallucinating on my setup. Do you have a rating for most appropriate local models for local agenting tasks? I also tried kimi2.6, qwen3.6 - no luck.

colescodes27 hari yang lalu

I'd try Qwen 3.6 35B-A3B or 27B with a temperature of around 0.6. You'd need to offload some of it to RAM though. I've had okay luck with Gemma 4 12B with a temperature of 1.0 but it will miss things a lot :(

denn-gubsky27 hari yang lalu

Thank you. Gemma4:e4b with temperature 0.9 works pretty good with tools (Bash, Glob, Red/Write and WebFetch) And it is fast. Will try the Qwen 3.6 later today.

[deleted]28 hari yang lalu