HackerTrans
TopNewTrendsCommentsPastAskShowJobs

jonaustin

no profile record

comments

jonaustin
·há 8 dias·discuss
I just started using it on an m4 max 128 and it's the first time since buying the machine a year ago that it feels like local llm "just works" for reasonably decent coding.

Use pi though; claude code has way too much bootstrap context; slows everything way down.
jonaustin
·mês passado·discuss
The handling of that issue looks _incredibly_ shady.

Not touching this project with a ten foot pole..
jonaustin
·mês passado·discuss
Probably use Morphe now: https://www.reddit.com/r/revancedextended/comments/1q20ga5/w...
jonaustin
·há 2 meses·discuss
Don Ho handled this like an absolute champ.

I think the cloner had good intent, but he didn't get approval, so absolutely not okay no matter what.
jonaustin
·há 3 meses·discuss
https://github.com/jundot/omlx

note: 27b is going to be slow; use the 35b MoE if you want decent token/sec speed.
jonaustin
·há 3 meses·discuss
Try https://github.com/jundot/omlx

I've been using qwen3.5 (122b) with claude code for months, and it's definitely dumber than sonnet/opus, but it works through things reasonably well (i.e. writes half-decent code and tool calls usually work), and I pretty much never run into loops now.

and make sure you're following Unsloth's recommendations for temperature/etc.
jonaustin
·há 3 meses·discuss
This is pretty much literally what the originator of Zen, Bodhidharma did for 9 years: https://en.wikipedia.org/wiki/Bodhidharma
jonaustin
·há 3 meses·discuss
or just use glow which is golang.

https://github.com/charmbracelet/glow
jonaustin
·há 3 meses·discuss
Just get a decent macbook, use LM Studio or OMLX and the latest qwen model you can fit in unified ram.

Hooking up Claude Code to it is trivial with omlx.

https://github.com/jundot/omlx
jonaustin
·há 3 meses·discuss
And shout-out to Qwen if they release 122b -- Jeff Barr's original Gemma 4 tweet said they'd release a ~122b, then it got redacted :(
jonaustin
·há 3 meses·discuss
Just use this; it's literally claude code in a terminal tab in vim; also aware of what files are open in vim.

https://github.com/coder/claudecode.nvim
jonaustin
·há 3 meses·discuss
You're holding it wrong if you're dragging files around a desktop to open them.

Just use a fuzzy file finder within the terminal or within vim itself.
jonaustin
·há 4 meses·discuss
I'd compare this more to the early days of the internet.

Is it necessary to get involved right now? Perhaps not. Is it neat to be part of a transformative historical change just getting it's feet under it? Yep.
jonaustin
·há 4 meses·discuss
Try with qwen 3.5 122b; it has more parameters so a larger corpus of knowledge to draw from than 35b.
jonaustin
·há 4 meses·discuss
122b is probably better; especially on a mac with 128gb memory.

localllama thread on this: https://www.reddit.com/r/LocalLLaMA/comments/1rk01ea/qwen351... (see comments for actual real usage rather thank benchmarks)

But for nvidia gpus 27b on a 3090 or similar is where it's at for sure.
jonaustin
·há 5 meses·discuss
Glow is pretty great and has been around for a while:

https://github.com/charmbracelet/glow
jonaustin
·há 5 meses·discuss
MacOS; no mcp; clear context; reliably reproducible when asking claude review a pr with a big VCR cassette.
jonaustin
·há 5 meses·discuss
How about how Claude 2.1.x is "literally unusable" because it frequently completely hangs (requires kill -9) and uses 100% cpu?

https://github.com/anthropics/claude-code/issues/18532
jonaustin
·há 7 meses·discuss
huh, well i got it on my work account, but my personal claude pro account still doesn't seem to have it available (2.0.76)
jonaustin
·há 7 meses·discuss
might need to upgrade claude code