HackerTrans
TopNewTrendsCommentsPastAskShowJobs

kroaton

no profile record

comments

kroaton
·12 วันที่ผ่านมา·discuss
Please don't use that garbage. Just use the base Qwen models or Nex/Orinth, as those are the only properly post-trained finetunes. The Qwopus models are marketing.
kroaton
·12 วันที่ผ่านมา·discuss
"DeepSeek-V4-Flash will fit" At Q2, 2bit? Lobotomized to death.
kroaton
·12 วันที่ผ่านมา·discuss
NVFP4 will be better if the model provider actually post-trained properly after quantizing.
kroaton
·12 วันที่ผ่านมา·discuss
You're late to the party, mate; we've been doing this for years. Grab a SearXNG instance, stand up an MCP server for it, and expose the tool into your system prompt. Or use Brave Search. Or Exa if you want to pay. Any of them work. The model will pick it up straight away.

Even llama.cpp's bundled web UI handles it fine. Dead simple.
kroaton
·12 วันที่ผ่านมา·discuss
https://github.com/nexu-io/open-design
kroaton
·26 วันที่ผ่านมา·discuss
This has been answered many times already. The short version: Brave's adblocker is not an extension, so manifest v3 has no effect on it.
kroaton
·30 วันที่ผ่านมา·discuss
To be fair, GPT5.5-Xhigh is similarly capable and has not burned the world down.
kroaton
·เดือนที่แล้ว·discuss
Anthropic nuked a big chunk of that "developer sentiment" when they rug-pulled us with the rate limits and gaslit us with "it was just a bug, guys!".
kroaton
·เดือนที่แล้ว·discuss
How is this not getting any traction? This is a massive problem. Pretty much every Reddit news app out there is now dead.
kroaton
·2 เดือนที่ผ่านมา·discuss
Did you even use it? It was nerfed to hell and back. It stopped following instructions, forgot what sub-agents responded and so on. Stop spreading this pro-Anthropic narrative. They did a rug pull due to lack of compute.
kroaton
·2 เดือนที่ผ่านมา·discuss
If Tauri ever gets proper webgpu support, that'll be the Electron killer.
kroaton
·2 เดือนที่ผ่านมา·discuss
Claude Code poisons non-anthropic models in usage. We found this out when the code was leaked. Use a fork or OpenCode/pi-coding-agent
kroaton
·3 เดือนที่ผ่านมา·discuss
Ask western models about Israel's genocides and mass rapes in Palestine, Lebanon, etc.
kroaton
·3 เดือนที่ผ่านมา·discuss
Buy any Strix Halo box and have fun with your 128GB of VRAM.
kroaton
·3 เดือนที่ผ่านมา·discuss
A3B-35B is better suited for laptops with enough VRAM/RAM. This dense model however will be bandwidth limited on most cards.

The 5090RTX mobile sits at 896GB/s, as opposed to the 1.8TB/s of the 5090 desktop and most mobile chips have way smaller bandwith than that, so speeds won't be incredible across the board like with Desktop computers.
kroaton
·4 เดือนที่ผ่านมา·discuss
For autocomplete, Qwen 3.5 9B should be enough even at Q4_k_m. The upcoming coding/math Omnicoder-2 finetune might be useful (should be released in a few days).

Either that or just load up Qwen3.5-35B-A3B-Q4_K_S I'm serving it at about 40-50t/s on a 4070RTX Super 12GB + 64GB of RAM. The weights are 20.7GB + KV Cache (which should be lowered soon with the upcoming addition of TurboQuant).
kroaton
·4 เดือนที่ผ่านมา·discuss
I did the same a few months ago when I read that multiple big OSS Linux projects were moving to it and it's been phenomenal so far.
kroaton
·4 เดือนที่ผ่านมา·discuss
It could just as easily be a $3000-4000 Strix Halo laptop.
kroaton
·4 เดือนที่ผ่านมา·discuss
If SPTM is active on the chip, we are not going to be getting Linux at all.
kroaton
·6 เดือนที่ผ่านมา·discuss
Loving this; great work! Do you talk about the process anywhere in more depth?