HackerTrans
TopNewTrendsCommentsPastAskShowJobs

discobot

no profile record

comments

discobot
·2 yıl önce·discuss
I legitimately dont know how to reply, bc by this point llms co-own all aspects of my life and jumps between gpt4->claude3->claude3.5->o1 have all been very noticeable
discobot
·2 yıl önce·discuss
the problem is that last generation of the largest models failed to overcome smaller models on the benchmarks, see lack of new claude opus or gpt-5. The problem is probably in the benchmarks, but anyway.
discobot
·2 yıl önce·discuss
They explicitly train models only on public datasets
discobot
·3 yıl önce·discuss
regarding the prompt processing and token generation you are correct

it makes sense to benchmark them infependently since prompt processing is done in parralel for each token and is compute bound and token generation is sequential and bound by memory banwidth