HackerTrans
TopNewTrendsCommentsPastAskShowJobs

jonaustin

no profile record

comments

jonaustin
·10 days ago·discuss
I just started using it on an m4 max 128 and it's the first time since buying the machine a year ago that it feels like local llm "just works" for reasonably decent coding.

Use pi though; claude code has way too much bootstrap context; slows everything way down.
jonaustin
·last month·discuss
The handling of that issue looks _incredibly_ shady.

Not touching this project with a ten foot pole..
jonaustin
·last month·discuss
Probably use Morphe now: https://www.reddit.com/r/revancedextended/comments/1q20ga5/w...
jonaustin
·2 months ago·discuss
Don Ho handled this like an absolute champ.

I think the cloner had good intent, but he didn't get approval, so absolutely not okay no matter what.
jonaustin
·3 months ago·discuss
https://github.com/jundot/omlx

note: 27b is going to be slow; use the 35b MoE if you want decent token/sec speed.
jonaustin
·3 months ago·discuss
Try https://github.com/jundot/omlx

I've been using qwen3.5 (122b) with claude code for months, and it's definitely dumber than sonnet/opus, but it works through things reasonably well (i.e. writes half-decent code and tool calls usually work), and I pretty much never run into loops now.

and make sure you're following Unsloth's recommendations for temperature/etc.
jonaustin
·3 months ago·discuss
This is pretty much literally what the originator of Zen, Bodhidharma did for 9 years: https://en.wikipedia.org/wiki/Bodhidharma
jonaustin
·3 months ago·discuss
or just use glow which is golang.

https://github.com/charmbracelet/glow
jonaustin
·3 months ago·discuss
Just get a decent macbook, use LM Studio or OMLX and the latest qwen model you can fit in unified ram.

Hooking up Claude Code to it is trivial with omlx.

https://github.com/jundot/omlx
jonaustin
·3 months ago·discuss
And shout-out to Qwen if they release 122b -- Jeff Barr's original Gemma 4 tweet said they'd release a ~122b, then it got redacted :(
jonaustin
·4 months ago·discuss
Just use this; it's literally claude code in a terminal tab in vim; also aware of what files are open in vim.

https://github.com/coder/claudecode.nvim
jonaustin
·4 months ago·discuss
You're holding it wrong if you're dragging files around a desktop to open them.

Just use a fuzzy file finder within the terminal or within vim itself.
jonaustin
·4 months ago·discuss
I'd compare this more to the early days of the internet.

Is it necessary to get involved right now? Perhaps not. Is it neat to be part of a transformative historical change just getting it's feet under it? Yep.
jonaustin
·4 months ago·discuss
Try with qwen 3.5 122b; it has more parameters so a larger corpus of knowledge to draw from than 35b.
jonaustin
·4 months ago·discuss
122b is probably better; especially on a mac with 128gb memory.

localllama thread on this: https://www.reddit.com/r/LocalLLaMA/comments/1rk01ea/qwen351... (see comments for actual real usage rather thank benchmarks)

But for nvidia gpus 27b on a 3090 or similar is where it's at for sure.
jonaustin
·5 months ago·discuss
Glow is pretty great and has been around for a while:

https://github.com/charmbracelet/glow
jonaustin
·5 months ago·discuss
MacOS; no mcp; clear context; reliably reproducible when asking claude review a pr with a big VCR cassette.
jonaustin
·5 months ago·discuss
How about how Claude 2.1.x is "literally unusable" because it frequently completely hangs (requires kill -9) and uses 100% cpu?

https://github.com/anthropics/claude-code/issues/18532
jonaustin
·7 months ago·discuss
huh, well i got it on my work account, but my personal claude pro account still doesn't seem to have it available (2.0.76)
jonaustin
·7 months ago·discuss
might need to upgrade claude code