HackerTrans
トップ新着トレンドコメント過去質問紹介求人

jjssmith

no profile record

コメント

jjssmith
·25 日前·議論
> One really impressive thing about OpenAI is that most of the people running the company (on the technical side, at least) are under 35. Many of the important decisionmakers behind chatGPT are under 30.

During Gold Rush most 49ers were under 25, so there's still room for improvement!

[Continuing the analogy, you may find that many AI heroes are just those who happened to be closer to pools of TPUs and GPUs in the early days...]
jjssmith
·4 か月前·議論
LOL. This is a classical technique, Johnson-Linderstrauss etc. In this context, rediscovered every few years (recently months), e.g. here's 2017: https://proceedings.mlr.press/v70/suresh17a
jjssmith
·2 年前·議論
You might like an information-theoretic take on SpinQuant and the likes [1].

tl;dr: round((2*R)*x) is not a great idea for an R-bit quantization.

[1] https://arxiv.org/abs/2410.13780
jjssmith
·2 年前·議論
AFAIK, the Markov chain page ranker existed before Google (Jon Kleinberg's papers, e.g.), what Google paper added were some smaller bells and whistles, like using the text description of the hrefs.