HackerTrans
TopNewTrendsCommentsPastAskShowJobs

randomgermanguy

no profile record

Submissions

Optimizing a Rust Thread-Pool (Part 1/?)

jakobsachs.blog
2 points·by randomgermanguy·5 เดือนที่ผ่านมา·0 comments

InferenceX v2: Nvidia Blackwell vs AMD vs. Hopper – SemiAnalysis

newsletter.semianalysis.com
4 points·by randomgermanguy·5 เดือนที่ผ่านมา·0 comments

The tiny corp – Nvidia is a Software Company

consensus-hongkong.coindesk.com
1 points·by randomgermanguy·5 เดือนที่ผ่านมา·0 comments

Ask HN: Anyone else disillusioned with "AI experts" in their team?

42 points·by randomgermanguy·8 เดือนที่ผ่านมา·59 comments

The Virtue of Building from Source

jakobsachs.blog
2 points·by randomgermanguy·10 เดือนที่ผ่านมา·0 comments

comments

randomgermanguy
·3 เดือนที่ผ่านมา·discuss
Definitely something in this realm, they call the models "preview" at a bunch of different points in the paper.

What im really hoping is for a double-punch like with V3 -> R1
randomgermanguy
·3 เดือนที่ผ่านมา·discuss
> "can I get my coding work actually done today" vs. "this can do customer support chat"

I think you need to define "can get coding work done" for this to make sense. Ive been using GPT-3 back-then for basic scripts, does that count ? Or only Claude-Code ?

I also think this is a false dichotomy, if you look at the Project Vend project or Vending-Bench, customer support etc. is at no means trivial. (Old but great story https://www.businessinsider.com/car-dealership-chevrolet-cha...)
randomgermanguy
·3 เดือนที่ผ่านมา·discuss
I mean its almost halve a year, i think that counts ?
randomgermanguy
·3 เดือนที่ผ่านมา·discuss
Only comparing on SOTA scores (ignoring price etc.) is like choosing your daily-driver by looking at who makes the fastest sports-car...
randomgermanguy
·3 เดือนที่ผ่านมา·discuss
If you found a rare 9000 card with 200+ GB of VRAM, sure
randomgermanguy
·3 เดือนที่ผ่านมา·discuss
I think the general question is if they'll release it at all, haven't yet read anything stating that they would
randomgermanguy
·3 เดือนที่ผ่านมา·discuss
One can see the impact of this cultural-wave on people above ~40 pretty heavily.

Hand-in-hand with the whole "Atomkraft ? Nein Danke" campaign. (https://en.wikipedia.org/wiki/Nuclear_Power%3F_No_Thanks)
randomgermanguy
·4 เดือนที่ผ่านมา·discuss
The major selling point of the tinyboxes is that you're able to run them in your office without any hassle.

I used to own a Dell Poweredge for my home-office, but those fans even on minimal setting kept me up at night
randomgermanguy
·4 เดือนที่ผ่านมา·discuss
Yes, but in practice land-ownership is only zero sum in places like Europe where every square-kilometer has 300 years of documented ownership etc, or other high-density areas.

The Asia, Africa & the Americas have so much unused space that isn't as inhospitable as central Australia
randomgermanguy
·4 เดือนที่ผ่านมา·discuss
I think the author might argue, that simply becoming more efficient at creating a rent-seeking mechanism is not beneficial. No matter how well motivated you are to improve your zero-sum game skills, it's still zero-sum.

Or something like that.
randomgermanguy
·4 เดือนที่ผ่านมา·discuss
You can already buy A100/H100s on eBay. While it might not ever be economical to run these at home (cost of electricity), but it's plenty fun.
randomgermanguy
·5 เดือนที่ผ่านมา·discuss
Cool idea, but kinda sad that it has to go through a cloud-provider. I feel like there's a possibility with an accelerator-board (Coral TPU or something), to make this into a totally local thing maybe? The longer-waiting time is surely not an issue when considering how many people still use Polaroids.
randomgermanguy
·5 เดือนที่ผ่านมา·discuss
why would I believe a random account with 1k followers ?
randomgermanguy
·7 เดือนที่ผ่านมา·discuss
The fact that I have to give them an email for details just feels immediately like a B2B-scam.

Hope they can figure out software, but what im seeing isn't super-promising
randomgermanguy
·8 เดือนที่ผ่านมา·discuss
I started using https://github.com/kushalpandya/Petrichor a while ago.

Though design is more akin to the default Apple Music app than WinAmp.
randomgermanguy
·8 เดือนที่ผ่านมา·discuss
Always love seeing a new BMC talk
randomgermanguy
·8 เดือนที่ผ่านมา·discuss
Made my eyes glaze over only slightly faster than trying to listen to the real Zizek.

Well done!
randomgermanguy
·8 เดือนที่ผ่านมา·discuss
I guess the question is if it's like the crypto-bubble, where theres no real value left in the end (haven't heard of a good use for those ASICs). Or more like the dot-com bubble where fiber-cable installed is still valuable without pets.com around.

But since I wasn't really around for either of those ... ¯\_ (ツ)_/¯
randomgermanguy
·8 เดือนที่ผ่านมา·discuss
Alright fair enough.

I dont think this is relevant to the main-point, but it's definitely something I wasn't aware of. I would've thought it might have an impact on like O(100)th token in some negligible way, but glad to learn.
randomgermanguy
·8 เดือนที่ผ่านมา·discuss
Okay yes, but would you really say that the main part of non-determinism in LLM-usage stems from this ? No its obviously the topk sampling.

I don't think my tech-lead was trying to suggest the floating-point error/non-associativity was the real source.