HackerTrans
TopNewTrendsCommentsPastAskShowJobs

jonaustin

no profile record

comments

jonaustin
·9 hari yang lalu·discuss
I just started using it on an m4 max 128 and it's the first time since buying the machine a year ago that it feels like local llm "just works" for reasonably decent coding.

Use pi though; claude code has way too much bootstrap context; slows everything way down.
jonaustin
·bulan lalu·discuss
The handling of that issue looks _incredibly_ shady.

Not touching this project with a ten foot pole..
jonaustin
·bulan lalu·discuss
Probably use Morphe now: https://www.reddit.com/r/revancedextended/comments/1q20ga5/w...
jonaustin
·2 bulan yang lalu·discuss
Don Ho handled this like an absolute champ.

I think the cloner had good intent, but he didn't get approval, so absolutely not okay no matter what.
jonaustin
·3 bulan yang lalu·discuss
https://github.com/jundot/omlx

note: 27b is going to be slow; use the 35b MoE if you want decent token/sec speed.
jonaustin
·3 bulan yang lalu·discuss
Try https://github.com/jundot/omlx

I've been using qwen3.5 (122b) with claude code for months, and it's definitely dumber than sonnet/opus, but it works through things reasonably well (i.e. writes half-decent code and tool calls usually work), and I pretty much never run into loops now.

and make sure you're following Unsloth's recommendations for temperature/etc.
jonaustin
·3 bulan yang lalu·discuss
This is pretty much literally what the originator of Zen, Bodhidharma did for 9 years: https://en.wikipedia.org/wiki/Bodhidharma
jonaustin
·3 bulan yang lalu·discuss
or just use glow which is golang.

https://github.com/charmbracelet/glow
jonaustin
·3 bulan yang lalu·discuss
Just get a decent macbook, use LM Studio or OMLX and the latest qwen model you can fit in unified ram.

Hooking up Claude Code to it is trivial with omlx.

https://github.com/jundot/omlx
jonaustin
·3 bulan yang lalu·discuss
And shout-out to Qwen if they release 122b -- Jeff Barr's original Gemma 4 tweet said they'd release a ~122b, then it got redacted :(
jonaustin
·3 bulan yang lalu·discuss
Just use this; it's literally claude code in a terminal tab in vim; also aware of what files are open in vim.

https://github.com/coder/claudecode.nvim
jonaustin
·3 bulan yang lalu·discuss
You're holding it wrong if you're dragging files around a desktop to open them.

Just use a fuzzy file finder within the terminal or within vim itself.
jonaustin
·4 bulan yang lalu·discuss
I'd compare this more to the early days of the internet.

Is it necessary to get involved right now? Perhaps not. Is it neat to be part of a transformative historical change just getting it's feet under it? Yep.
jonaustin
·4 bulan yang lalu·discuss
Try with qwen 3.5 122b; it has more parameters so a larger corpus of knowledge to draw from than 35b.
jonaustin
·4 bulan yang lalu·discuss
122b is probably better; especially on a mac with 128gb memory.

localllama thread on this: https://www.reddit.com/r/LocalLLaMA/comments/1rk01ea/qwen351... (see comments for actual real usage rather thank benchmarks)

But for nvidia gpus 27b on a 3090 or similar is where it's at for sure.
jonaustin
·5 bulan yang lalu·discuss
Glow is pretty great and has been around for a while:

https://github.com/charmbracelet/glow
jonaustin
·5 bulan yang lalu·discuss
MacOS; no mcp; clear context; reliably reproducible when asking claude review a pr with a big VCR cassette.
jonaustin
·5 bulan yang lalu·discuss
How about how Claude 2.1.x is "literally unusable" because it frequently completely hangs (requires kill -9) and uses 100% cpu?

https://github.com/anthropics/claude-code/issues/18532
jonaustin
·7 bulan yang lalu·discuss
huh, well i got it on my work account, but my personal claude pro account still doesn't seem to have it available (2.0.76)
jonaustin
·7 bulan yang lalu·discuss
might need to upgrade claude code