HackerTrans
トップ新着トレンドコメント過去質問紹介求人

discobot

no profile record

コメント

discobot
·2 年前·議論
I legitimately dont know how to reply, bc by this point llms co-own all aspects of my life and jumps between gpt4->claude3->claude3.5->o1 have all been very noticeable
discobot
·2 年前·議論
the problem is that last generation of the largest models failed to overcome smaller models on the benchmarks, see lack of new claude opus or gpt-5. The problem is probably in the benchmarks, but anyway.
discobot
·2 年前·議論
They explicitly train models only on public datasets
discobot
·3 年前·議論
regarding the prompt processing and token generation you are correct

it makes sense to benchmark them infependently since prompt processing is done in parralel for each token and is compute bound and token generation is sequential and bound by memory banwidth