HackerTrans
TopNewTrendsCommentsPastAskShowJobs

jonaustin

no profile record

comments

jonaustin
·8 gün önce·discuss
I just started using it on an m4 max 128 and it's the first time since buying the machine a year ago that it feels like local llm "just works" for reasonably decent coding.

Use pi though; claude code has way too much bootstrap context; slows everything way down.
jonaustin
·geçen ay·discuss
The handling of that issue looks _incredibly_ shady.

Not touching this project with a ten foot pole..
jonaustin
·geçen ay·discuss
Probably use Morphe now: https://www.reddit.com/r/revancedextended/comments/1q20ga5/w...
jonaustin
·2 ay önce·discuss
Don Ho handled this like an absolute champ.

I think the cloner had good intent, but he didn't get approval, so absolutely not okay no matter what.
jonaustin
·3 ay önce·discuss
https://github.com/jundot/omlx

note: 27b is going to be slow; use the 35b MoE if you want decent token/sec speed.
jonaustin
·3 ay önce·discuss
Try https://github.com/jundot/omlx

I've been using qwen3.5 (122b) with claude code for months, and it's definitely dumber than sonnet/opus, but it works through things reasonably well (i.e. writes half-decent code and tool calls usually work), and I pretty much never run into loops now.

and make sure you're following Unsloth's recommendations for temperature/etc.
jonaustin
·3 ay önce·discuss
This is pretty much literally what the originator of Zen, Bodhidharma did for 9 years: https://en.wikipedia.org/wiki/Bodhidharma
jonaustin
·3 ay önce·discuss
or just use glow which is golang.

https://github.com/charmbracelet/glow
jonaustin
·3 ay önce·discuss
Just get a decent macbook, use LM Studio or OMLX and the latest qwen model you can fit in unified ram.

Hooking up Claude Code to it is trivial with omlx.

https://github.com/jundot/omlx
jonaustin
·3 ay önce·discuss
And shout-out to Qwen if they release 122b -- Jeff Barr's original Gemma 4 tweet said they'd release a ~122b, then it got redacted :(
jonaustin
·3 ay önce·discuss
Just use this; it's literally claude code in a terminal tab in vim; also aware of what files are open in vim.

https://github.com/coder/claudecode.nvim
jonaustin
·3 ay önce·discuss
You're holding it wrong if you're dragging files around a desktop to open them.

Just use a fuzzy file finder within the terminal or within vim itself.
jonaustin
·4 ay önce·discuss
I'd compare this more to the early days of the internet.

Is it necessary to get involved right now? Perhaps not. Is it neat to be part of a transformative historical change just getting it's feet under it? Yep.
jonaustin
·4 ay önce·discuss
Try with qwen 3.5 122b; it has more parameters so a larger corpus of knowledge to draw from than 35b.
jonaustin
·4 ay önce·discuss
122b is probably better; especially on a mac with 128gb memory.

localllama thread on this: https://www.reddit.com/r/LocalLLaMA/comments/1rk01ea/qwen351... (see comments for actual real usage rather thank benchmarks)

But for nvidia gpus 27b on a 3090 or similar is where it's at for sure.
jonaustin
·5 ay önce·discuss
Glow is pretty great and has been around for a while:

https://github.com/charmbracelet/glow
jonaustin
·5 ay önce·discuss
MacOS; no mcp; clear context; reliably reproducible when asking claude review a pr with a big VCR cassette.
jonaustin
·5 ay önce·discuss
How about how Claude 2.1.x is "literally unusable" because it frequently completely hangs (requires kill -9) and uses 100% cpu?

https://github.com/anthropics/claude-code/issues/18532
jonaustin
·7 ay önce·discuss
huh, well i got it on my work account, but my personal claude pro account still doesn't seem to have it available (2.0.76)
jonaustin
·7 ay önce·discuss
might need to upgrade claude code