HackerTrans
TopNewTrendsCommentsPastAskShowJobs

randomgermanguy

no profile record

Submissions

Optimizing a Rust Thread-Pool (Part 1/?)

jakobsachs.blog
2 points·by randomgermanguy·5 mesi fa·0 comments

InferenceX v2: Nvidia Blackwell vs AMD vs. Hopper – SemiAnalysis

newsletter.semianalysis.com
4 points·by randomgermanguy·5 mesi fa·0 comments

The tiny corp – Nvidia is a Software Company

consensus-hongkong.coindesk.com
1 points·by randomgermanguy·5 mesi fa·0 comments

Ask HN: Anyone else disillusioned with "AI experts" in their team?

42 points·by randomgermanguy·8 mesi fa·59 comments

The Virtue of Building from Source

jakobsachs.blog
2 points·by randomgermanguy·10 mesi fa·0 comments

comments

randomgermanguy
·3 mesi fa·discuss
Definitely something in this realm, they call the models "preview" at a bunch of different points in the paper.

What im really hoping is for a double-punch like with V3 -> R1
randomgermanguy
·3 mesi fa·discuss
> "can I get my coding work actually done today" vs. "this can do customer support chat"

I think you need to define "can get coding work done" for this to make sense. Ive been using GPT-3 back-then for basic scripts, does that count ? Or only Claude-Code ?

I also think this is a false dichotomy, if you look at the Project Vend project or Vending-Bench, customer support etc. is at no means trivial. (Old but great story https://www.businessinsider.com/car-dealership-chevrolet-cha...)
randomgermanguy
·3 mesi fa·discuss
I mean its almost halve a year, i think that counts ?
randomgermanguy
·3 mesi fa·discuss
Only comparing on SOTA scores (ignoring price etc.) is like choosing your daily-driver by looking at who makes the fastest sports-car...
randomgermanguy
·3 mesi fa·discuss
If you found a rare 9000 card with 200+ GB of VRAM, sure
randomgermanguy
·3 mesi fa·discuss
I think the general question is if they'll release it at all, haven't yet read anything stating that they would
randomgermanguy
·3 mesi fa·discuss
One can see the impact of this cultural-wave on people above ~40 pretty heavily.

Hand-in-hand with the whole "Atomkraft ? Nein Danke" campaign. (https://en.wikipedia.org/wiki/Nuclear_Power%3F_No_Thanks)
randomgermanguy
·4 mesi fa·discuss
The major selling point of the tinyboxes is that you're able to run them in your office without any hassle.

I used to own a Dell Poweredge for my home-office, but those fans even on minimal setting kept me up at night
randomgermanguy
·4 mesi fa·discuss
Yes, but in practice land-ownership is only zero sum in places like Europe where every square-kilometer has 300 years of documented ownership etc, or other high-density areas.

The Asia, Africa & the Americas have so much unused space that isn't as inhospitable as central Australia
randomgermanguy
·4 mesi fa·discuss
I think the author might argue, that simply becoming more efficient at creating a rent-seeking mechanism is not beneficial. No matter how well motivated you are to improve your zero-sum game skills, it's still zero-sum.

Or something like that.
randomgermanguy
·4 mesi fa·discuss
You can already buy A100/H100s on eBay. While it might not ever be economical to run these at home (cost of electricity), but it's plenty fun.
randomgermanguy
·5 mesi fa·discuss
Cool idea, but kinda sad that it has to go through a cloud-provider. I feel like there's a possibility with an accelerator-board (Coral TPU or something), to make this into a totally local thing maybe? The longer-waiting time is surely not an issue when considering how many people still use Polaroids.
randomgermanguy
·5 mesi fa·discuss
why would I believe a random account with 1k followers ?
randomgermanguy
·8 mesi fa·discuss
The fact that I have to give them an email for details just feels immediately like a B2B-scam.

Hope they can figure out software, but what im seeing isn't super-promising
randomgermanguy
·8 mesi fa·discuss
I started using https://github.com/kushalpandya/Petrichor a while ago.

Though design is more akin to the default Apple Music app than WinAmp.
randomgermanguy
·8 mesi fa·discuss
Always love seeing a new BMC talk
randomgermanguy
·8 mesi fa·discuss
Made my eyes glaze over only slightly faster than trying to listen to the real Zizek.

Well done!
randomgermanguy
·8 mesi fa·discuss
I guess the question is if it's like the crypto-bubble, where theres no real value left in the end (haven't heard of a good use for those ASICs). Or more like the dot-com bubble where fiber-cable installed is still valuable without pets.com around.

But since I wasn't really around for either of those ... ¯\_ (ツ)_/¯
randomgermanguy
·8 mesi fa·discuss
Alright fair enough.

I dont think this is relevant to the main-point, but it's definitely something I wasn't aware of. I would've thought it might have an impact on like O(100)th token in some negligible way, but glad to learn.
randomgermanguy
·8 mesi fa·discuss
Okay yes, but would you really say that the main part of non-determinism in LLM-usage stems from this ? No its obviously the topk sampling.

I don't think my tech-lead was trying to suggest the floating-point error/non-associativity was the real source.