HackerLangs
TopNewTrendsCommentsPastAskShowJobs

colescodes

3 karmajoined il y a 2 mois
Hey, I’m Matt - a Principal Engineer at AWS, living in Melbourne, Australia . I build things and write up the bits worth keeping.

https://coles.codes

Submissions

[untitled]

1 points·by colescodes·il y a 16 heures·0 comments

[untitled]

1 points·by colescodes·il y a 5 jours·0 comments

[untitled]

1 points·by colescodes·il y a 24 jours·0 comments

[untitled]

1 points·by colescodes·il y a 26 jours·0 comments

Local Models in Mid-2026

coles.codes
3 points·by colescodes·il y a 27 jours·3 comments

[untitled]

1 points·by colescodes·il y a 30 jours·0 comments

Understanding KV Cache: The Hidden Memory Cost of Serving LLMs

melchi.me
3 points·by colescodes·il y a 2 mois·0 comments

comments

colescodes
·il y a 27 jours·discuss
I'd try Qwen 3.6 35B-A3B or 27B with a temperature of around 0.6. You'd need to offload some of it to RAM though. I've had okay luck with Gemma 4 12B with a temperature of 1.0 but it will miss things a lot :(
colescodes
·il y a 2 mois·discuss
[flagged]