HackerTrans
TopNewTrendsCommentsPastAskShowJobs

jjssmith

no profile record

comments

jjssmith
·25 hari yang lalu·discuss
> One really impressive thing about OpenAI is that most of the people running the company (on the technical side, at least) are under 35. Many of the important decisionmakers behind chatGPT are under 30.

During Gold Rush most 49ers were under 25, so there's still room for improvement!

[Continuing the analogy, you may find that many AI heroes are just those who happened to be closer to pools of TPUs and GPUs in the early days...]
jjssmith
·4 bulan yang lalu·discuss
LOL. This is a classical technique, Johnson-Linderstrauss etc. In this context, rediscovered every few years (recently months), e.g. here's 2017: https://proceedings.mlr.press/v70/suresh17a
jjssmith
·2 tahun yang lalu·discuss
You might like an information-theoretic take on SpinQuant and the likes [1].

tl;dr: round((2*R)*x) is not a great idea for an R-bit quantization.

[1] https://arxiv.org/abs/2410.13780
jjssmith
·2 tahun yang lalu·discuss
AFAIK, the Markov chain page ranker existed before Google (Jon Kleinberg's papers, e.g.), what Google paper added were some smaller bells and whistles, like using the text description of the hrefs.