HackerTrans
トップ新着トレンドコメント過去質問紹介求人

jonaustin

no profile record

コメント

jonaustin
·8 日前·議論
I just started using it on an m4 max 128 and it's the first time since buying the machine a year ago that it feels like local llm "just works" for reasonably decent coding.

Use pi though; claude code has way too much bootstrap context; slows everything way down.
jonaustin
·先月·議論
The handling of that issue looks _incredibly_ shady.

Not touching this project with a ten foot pole..
jonaustin
·先月·議論
Probably use Morphe now: https://www.reddit.com/r/revancedextended/comments/1q20ga5/w...
jonaustin
·2 か月前·議論
Don Ho handled this like an absolute champ.

I think the cloner had good intent, but he didn't get approval, so absolutely not okay no matter what.
jonaustin
·3 か月前·議論
https://github.com/jundot/omlx

note: 27b is going to be slow; use the 35b MoE if you want decent token/sec speed.
jonaustin
·3 か月前·議論
Try https://github.com/jundot/omlx

I've been using qwen3.5 (122b) with claude code for months, and it's definitely dumber than sonnet/opus, but it works through things reasonably well (i.e. writes half-decent code and tool calls usually work), and I pretty much never run into loops now.

and make sure you're following Unsloth's recommendations for temperature/etc.
jonaustin
·3 か月前·議論
This is pretty much literally what the originator of Zen, Bodhidharma did for 9 years: https://en.wikipedia.org/wiki/Bodhidharma
jonaustin
·3 か月前·議論
or just use glow which is golang.

https://github.com/charmbracelet/glow
jonaustin
·3 か月前·議論
Just get a decent macbook, use LM Studio or OMLX and the latest qwen model you can fit in unified ram.

Hooking up Claude Code to it is trivial with omlx.

https://github.com/jundot/omlx
jonaustin
·3 か月前·議論
And shout-out to Qwen if they release 122b -- Jeff Barr's original Gemma 4 tweet said they'd release a ~122b, then it got redacted :(
jonaustin
·3 か月前·議論
Just use this; it's literally claude code in a terminal tab in vim; also aware of what files are open in vim.

https://github.com/coder/claudecode.nvim
jonaustin
·3 か月前·議論
You're holding it wrong if you're dragging files around a desktop to open them.

Just use a fuzzy file finder within the terminal or within vim itself.
jonaustin
·4 か月前·議論
I'd compare this more to the early days of the internet.

Is it necessary to get involved right now? Perhaps not. Is it neat to be part of a transformative historical change just getting it's feet under it? Yep.
jonaustin
·4 か月前·議論
Try with qwen 3.5 122b; it has more parameters so a larger corpus of knowledge to draw from than 35b.
jonaustin
·4 か月前·議論
122b is probably better; especially on a mac with 128gb memory.

localllama thread on this: https://www.reddit.com/r/LocalLLaMA/comments/1rk01ea/qwen351... (see comments for actual real usage rather thank benchmarks)

But for nvidia gpus 27b on a 3090 or similar is where it's at for sure.
jonaustin
·5 か月前·議論
Glow is pretty great and has been around for a while:

https://github.com/charmbracelet/glow
jonaustin
·5 か月前·議論
MacOS; no mcp; clear context; reliably reproducible when asking claude review a pr with a big VCR cassette.
jonaustin
·5 か月前·議論
How about how Claude 2.1.x is "literally unusable" because it frequently completely hangs (requires kill -9) and uses 100% cpu?

https://github.com/anthropics/claude-code/issues/18532
jonaustin
·7 か月前·議論
huh, well i got it on my work account, but my personal claude pro account still doesn't seem to have it available (2.0.76)
jonaustin
·7 か月前·議論
might need to upgrade claude code