HackerTrans
TopNewTrendsCommentsPastAskShowJobs

discobot

no profile record

comments

discobot
·2 lata temu·discuss
I legitimately dont know how to reply, bc by this point llms co-own all aspects of my life and jumps between gpt4->claude3->claude3.5->o1 have all been very noticeable
discobot
·2 lata temu·discuss
the problem is that last generation of the largest models failed to overcome smaller models on the benchmarks, see lack of new claude opus or gpt-5. The problem is probably in the benchmarks, but anyway.
discobot
·2 lata temu·discuss
They explicitly train models only on public datasets
discobot
·3 lata temu·discuss
regarding the prompt processing and token generation you are correct

it makes sense to benchmark them infependently since prompt processing is done in parralel for each token and is compute bound and token generation is sequential and bound by memory banwidth