HackerTrans
TopNewTrendsCommentsPastAskShowJobs

randomgermanguy

no profile record

Submissions

Optimizing a Rust Thread-Pool (Part 1/?)

jakobsachs.blog
2 points·by randomgermanguy·vor 5 Monaten·0 comments

InferenceX v2: Nvidia Blackwell vs AMD vs. Hopper – SemiAnalysis

newsletter.semianalysis.com
4 points·by randomgermanguy·vor 5 Monaten·0 comments

The tiny corp – Nvidia is a Software Company

consensus-hongkong.coindesk.com
1 points·by randomgermanguy·vor 5 Monaten·0 comments

Ask HN: Anyone else disillusioned with "AI experts" in their team?

42 points·by randomgermanguy·vor 8 Monaten·59 comments

The Virtue of Building from Source

jakobsachs.blog
2 points·by randomgermanguy·vor 10 Monaten·0 comments

comments

randomgermanguy
·vor 3 Monaten·discuss
Definitely something in this realm, they call the models "preview" at a bunch of different points in the paper.

What im really hoping is for a double-punch like with V3 -> R1
randomgermanguy
·vor 3 Monaten·discuss
> "can I get my coding work actually done today" vs. "this can do customer support chat"

I think you need to define "can get coding work done" for this to make sense. Ive been using GPT-3 back-then for basic scripts, does that count ? Or only Claude-Code ?

I also think this is a false dichotomy, if you look at the Project Vend project or Vending-Bench, customer support etc. is at no means trivial. (Old but great story https://www.businessinsider.com/car-dealership-chevrolet-cha...)
randomgermanguy
·vor 3 Monaten·discuss
I mean its almost halve a year, i think that counts ?
randomgermanguy
·vor 3 Monaten·discuss
Only comparing on SOTA scores (ignoring price etc.) is like choosing your daily-driver by looking at who makes the fastest sports-car...
randomgermanguy
·vor 3 Monaten·discuss
If you found a rare 9000 card with 200+ GB of VRAM, sure
randomgermanguy
·vor 3 Monaten·discuss
I think the general question is if they'll release it at all, haven't yet read anything stating that they would
randomgermanguy
·vor 3 Monaten·discuss
One can see the impact of this cultural-wave on people above ~40 pretty heavily.

Hand-in-hand with the whole "Atomkraft ? Nein Danke" campaign. (https://en.wikipedia.org/wiki/Nuclear_Power%3F_No_Thanks)
randomgermanguy
·vor 4 Monaten·discuss
The major selling point of the tinyboxes is that you're able to run them in your office without any hassle.

I used to own a Dell Poweredge for my home-office, but those fans even on minimal setting kept me up at night
randomgermanguy
·vor 4 Monaten·discuss
Yes, but in practice land-ownership is only zero sum in places like Europe where every square-kilometer has 300 years of documented ownership etc, or other high-density areas.

The Asia, Africa & the Americas have so much unused space that isn't as inhospitable as central Australia
randomgermanguy
·vor 4 Monaten·discuss
I think the author might argue, that simply becoming more efficient at creating a rent-seeking mechanism is not beneficial. No matter how well motivated you are to improve your zero-sum game skills, it's still zero-sum.

Or something like that.
randomgermanguy
·vor 4 Monaten·discuss
You can already buy A100/H100s on eBay. While it might not ever be economical to run these at home (cost of electricity), but it's plenty fun.
randomgermanguy
·vor 5 Monaten·discuss
Cool idea, but kinda sad that it has to go through a cloud-provider. I feel like there's a possibility with an accelerator-board (Coral TPU or something), to make this into a totally local thing maybe? The longer-waiting time is surely not an issue when considering how many people still use Polaroids.
randomgermanguy
·vor 5 Monaten·discuss
why would I believe a random account with 1k followers ?
randomgermanguy
·vor 7 Monaten·discuss
The fact that I have to give them an email for details just feels immediately like a B2B-scam.

Hope they can figure out software, but what im seeing isn't super-promising
randomgermanguy
·vor 8 Monaten·discuss
I started using https://github.com/kushalpandya/Petrichor a while ago.

Though design is more akin to the default Apple Music app than WinAmp.
randomgermanguy
·vor 8 Monaten·discuss
Always love seeing a new BMC talk
randomgermanguy
·vor 8 Monaten·discuss
Made my eyes glaze over only slightly faster than trying to listen to the real Zizek.

Well done!
randomgermanguy
·vor 8 Monaten·discuss
I guess the question is if it's like the crypto-bubble, where theres no real value left in the end (haven't heard of a good use for those ASICs). Or more like the dot-com bubble where fiber-cable installed is still valuable without pets.com around.

But since I wasn't really around for either of those ... ¯\_ (ツ)_/¯
randomgermanguy
·vor 8 Monaten·discuss
Alright fair enough.

I dont think this is relevant to the main-point, but it's definitely something I wasn't aware of. I would've thought it might have an impact on like O(100)th token in some negligible way, but glad to learn.
randomgermanguy
·vor 8 Monaten·discuss
Okay yes, but would you really say that the main part of non-determinism in LLM-usage stems from this ? No its obviously the topk sampling.

I don't think my tech-lead was trying to suggest the floating-point error/non-associativity was the real source.