HackerLangs
TopNewTrendsCommentsPastAskShowJobs

girvo

13,045 karmajoined 14 lat temu
Principal front-end engineer in Brisbane, Australia

Email me at josh (at) jgirvin (dot) com

https://jgirvin.com for my blog

@girvo on Twitter/Threads

comments

girvo
·8 godzin temu·discuss
Ctrl-shift-o -> scr is what I use. I love symbol navigation :)
girvo
·21 godzin temu·discuss
The closed models aren't giving you the real thinking traces, though.
girvo
·22 godziny temu·discuss
It's quite depressing how common this is on the front page of HN now.
girvo
·wczoraj·discuss
Having heavily evaluated both antirez’s ds4 flash and Qwen 3.6 27B at FP8 and Q8: it depends. The quantised Flash is better in a number of tasks despite running much slower on my DGX Spark-alike.

27B is amazing for its size but has some surprising limits when used for longer agentic coding sessions, especially if you’re using tools that are outside the stock standard web tech stuff: it really isn’t good at Relay, for example.
girvo
·przedwczoraj·discuss
The thing is the data isn’t limited, and supply side constraints already solve this problem. I come from a BSc Chemistry background, and they don’t hide how organic chemistry and illegal drug synthesis are intertwined, it’s open information

But where I live the glassware and precursors will get you a very angry knock on the door.
girvo
·przedwczoraj·discuss
I use benchmarks…

…that are my own private internal suite on my own code bases where I can judge the output properly

I also measure wall clock time to completion which has been a surprising separator in practice.
girvo
·3 dni temu·discuss
Except they straight up drop important clinical information. My partner has to go over it with a fine toothed comb and it saves her zero time.
girvo
·6 dni temu·discuss
That their vibes are more real than your vibes
girvo
·7 dni temu·discuss
Glad someone else is saying it. It has that exact LLM cadence to it, horrible.

The worst thing is, I'm pretty sure humans are starting to mimic that cadence too...
girvo
·10 dni temu·discuss
Depends on the model. Step (from StepFun) will happily yap about Tiannemen to you, if you're running it locally.

Quite a lot of these models have "safety" (lol) filters in front of them, vs it being heavily encoded into the weights not.
girvo
·10 dni temu·discuss
Truthfully? There isn't one. They all have flaws. Your best bet is to look at all of them, and then run a suite of evals yourself. Its rough out here!
girvo
·10 dni temu·discuss
The specific market positioning is... for me to use at my big tech company job, where we aren't allowed to use GLM and similar, but have fixed caps on how much token usage we're allowed to rack up a month.
girvo
·11 dni temu·discuss
Which basically only Nvidia does, because it’s very expensive.

Though I’m currently working on QADing the smaller Qwen 3.5 models from FP16 teacher to NVFP4 student, to hopefully eventually apply it to 3.6 27B… harder to get right than I expected though!
girvo
·11 dni temu·discuss
But prompt processing is terrible
girvo
·11 dni temu·discuss
It’s half a sentence to be fair, easy to miss!
girvo
·11 dni temu·discuss
Not Llama 3.1, but Step 3.7 Flash is one of the few new high quality models in this size bracket. DeepSeek v4 Flash too
girvo
·11 dni temu·discuss
My GB10 Spark-alike is absolutely amazingly fun… but it is not cost effective. Step 3.7 Flash is shockingly capable (IQ4_XS and used for web dev mainly), but it cost me $6800 AUD. They’re even more expensive now. The numbers just don’t make sense: with proper triple head MTP I can get it up to ~40tk/s decode and it runs at around 1000+ tk/s prefill.

$6800 is a lot of API credits for GLM, for example, on any provider you want to use.

Now being able to run models uncensored and with privacy has value! But the cost for these is rough today.

I still am going to buy a second one haha
girvo
·11 dni temu·discuss
Gemma is better than Qwen at everything except coding, in all my evaluations. Which is a shame because that is what I use them for!
girvo
·12 dni temu·discuss
The Super-R run-command dialog on Windows, and Notepad make it look crazy
girvo
·12 dni temu·discuss
Yes, it does:

> a genie-generated description of YAGNI intended for the improvement of future generations of genies