HackerTrans
TopNewTrendsCommentsPastAskShowJobs

randomgermanguy

no profile record

Submissions

Optimizing a Rust Thread-Pool (Part 1/?)

jakobsachs.blog
2 points·by randomgermanguy·5 miesięcy temu·0 comments

InferenceX v2: Nvidia Blackwell vs AMD vs. Hopper – SemiAnalysis

newsletter.semianalysis.com
4 points·by randomgermanguy·5 miesięcy temu·0 comments

The tiny corp – Nvidia is a Software Company

consensus-hongkong.coindesk.com
1 points·by randomgermanguy·5 miesięcy temu·0 comments

Ask HN: Anyone else disillusioned with "AI experts" in their team?

42 points·by randomgermanguy·8 miesięcy temu·59 comments

The Virtue of Building from Source

jakobsachs.blog
2 points·by randomgermanguy·10 miesięcy temu·0 comments

comments

randomgermanguy
·3 miesiące temu·discuss
Definitely something in this realm, they call the models "preview" at a bunch of different points in the paper.

What im really hoping is for a double-punch like with V3 -> R1
randomgermanguy
·3 miesiące temu·discuss
> "can I get my coding work actually done today" vs. "this can do customer support chat"

I think you need to define "can get coding work done" for this to make sense. Ive been using GPT-3 back-then for basic scripts, does that count ? Or only Claude-Code ?

I also think this is a false dichotomy, if you look at the Project Vend project or Vending-Bench, customer support etc. is at no means trivial. (Old but great story https://www.businessinsider.com/car-dealership-chevrolet-cha...)
randomgermanguy
·3 miesiące temu·discuss
I mean its almost halve a year, i think that counts ?
randomgermanguy
·3 miesiące temu·discuss
Only comparing on SOTA scores (ignoring price etc.) is like choosing your daily-driver by looking at who makes the fastest sports-car...
randomgermanguy
·3 miesiące temu·discuss
If you found a rare 9000 card with 200+ GB of VRAM, sure
randomgermanguy
·3 miesiące temu·discuss
I think the general question is if they'll release it at all, haven't yet read anything stating that they would
randomgermanguy
·3 miesiące temu·discuss
One can see the impact of this cultural-wave on people above ~40 pretty heavily.

Hand-in-hand with the whole "Atomkraft ? Nein Danke" campaign. (https://en.wikipedia.org/wiki/Nuclear_Power%3F_No_Thanks)
randomgermanguy
·4 miesiące temu·discuss
The major selling point of the tinyboxes is that you're able to run them in your office without any hassle.

I used to own a Dell Poweredge for my home-office, but those fans even on minimal setting kept me up at night
randomgermanguy
·4 miesiące temu·discuss
Yes, but in practice land-ownership is only zero sum in places like Europe where every square-kilometer has 300 years of documented ownership etc, or other high-density areas.

The Asia, Africa & the Americas have so much unused space that isn't as inhospitable as central Australia
randomgermanguy
·4 miesiące temu·discuss
I think the author might argue, that simply becoming more efficient at creating a rent-seeking mechanism is not beneficial. No matter how well motivated you are to improve your zero-sum game skills, it's still zero-sum.

Or something like that.
randomgermanguy
·4 miesiące temu·discuss
You can already buy A100/H100s on eBay. While it might not ever be economical to run these at home (cost of electricity), but it's plenty fun.
randomgermanguy
·5 miesięcy temu·discuss
Cool idea, but kinda sad that it has to go through a cloud-provider. I feel like there's a possibility with an accelerator-board (Coral TPU or something), to make this into a totally local thing maybe? The longer-waiting time is surely not an issue when considering how many people still use Polaroids.
randomgermanguy
·5 miesięcy temu·discuss
why would I believe a random account with 1k followers ?
randomgermanguy
·8 miesięcy temu·discuss
The fact that I have to give them an email for details just feels immediately like a B2B-scam.

Hope they can figure out software, but what im seeing isn't super-promising
randomgermanguy
·8 miesięcy temu·discuss
I started using https://github.com/kushalpandya/Petrichor a while ago.

Though design is more akin to the default Apple Music app than WinAmp.
randomgermanguy
·8 miesięcy temu·discuss
Always love seeing a new BMC talk
randomgermanguy
·8 miesięcy temu·discuss
Made my eyes glaze over only slightly faster than trying to listen to the real Zizek.

Well done!
randomgermanguy
·8 miesięcy temu·discuss
I guess the question is if it's like the crypto-bubble, where theres no real value left in the end (haven't heard of a good use for those ASICs). Or more like the dot-com bubble where fiber-cable installed is still valuable without pets.com around.

But since I wasn't really around for either of those ... ¯\_ (ツ)_/¯
randomgermanguy
·8 miesięcy temu·discuss
Alright fair enough.

I dont think this is relevant to the main-point, but it's definitely something I wasn't aware of. I would've thought it might have an impact on like O(100)th token in some negligible way, but glad to learn.
randomgermanguy
·8 miesięcy temu·discuss
Okay yes, but would you really say that the main part of non-determinism in LLM-usage stems from this ? No its obviously the topk sampling.

I don't think my tech-lead was trying to suggest the floating-point error/non-associativity was the real source.