HackerTrans
TopNewTrendsCommentsPastAskShowJobs

discobot

no profile record

comments

discobot
·2 anni fa·discuss
I legitimately dont know how to reply, bc by this point llms co-own all aspects of my life and jumps between gpt4->claude3->claude3.5->o1 have all been very noticeable
discobot
·2 anni fa·discuss
the problem is that last generation of the largest models failed to overcome smaller models on the benchmarks, see lack of new claude opus or gpt-5. The problem is probably in the benchmarks, but anyway.
discobot
·2 anni fa·discuss
They explicitly train models only on public datasets
discobot
·3 anni fa·discuss
regarding the prompt processing and token generation you are correct

it makes sense to benchmark them infependently since prompt processing is done in parralel for each token and is compute bound and token generation is sequential and bound by memory banwidth