HackerTrans
TopNewTrendsCommentsPastAskShowJobs

x_may

no profile record

comments

x_may
·2 bulan yang lalu·discuss
Yeah, but this is partly due to there being a shortage of entry level GPUs for consumers. NVIDIA has literally stopped manufacturing them.

There are massive numbers of data centre GPUs sitting in hyperscaler warehouses waiting to be deployed in a data centre. They may never be deployed because there’s more GPU than DC space and you want your most efficient GPUs in the active slots.
x_may
·4 bulan yang lalu·discuss
KV cache compression, so how much memory the model needs to use for extending its context. Does not affect the weight size.
x_may
·5 bulan yang lalu·discuss
Isn’t there also basically 0 American DRAM?
x_may
·5 bulan yang lalu·discuss
The 80/20 rule always wins
x_may
·5 bulan yang lalu·discuss
I just wanted deterministic outputs and was curious how you were doing it. Sounds like probably temp = 0, which major providers no longer offer. Thanks for your response.
x_may
·5 bulan yang lalu·discuss
Wait sorry how did you use and expose seeds? That’s the most interesting part of your post
x_may
·5 bulan yang lalu·discuss
It might have been explicitly targeted, but they did say that there were older versions of Notepad ++ with ""insufficient update verification controls" so it might have just been there was only one subset of users actually susceptible to this.
x_may
·6 bulan yang lalu·discuss
I believe the what the parent comment was referring to is the advice not to praise character, but instead praise hard work.

“You’re so smart” leaves room for failure when they encounter something that challenges their image of being smart. Praising the amount of effort they put in is not something that is taken away or challenged regardless of the outcome.
x_may
·tahun lalu·discuss
I think it’s also largely driven by the apparently cheapness of turning the CapEX of server buying to the OpEX of cloud renting. Less up front investment and auditing/access controls for SoC2 compliant are so much easier m.