HackerTrans
トップ新着トレンドコメント過去質問紹介求人

ankeshanand

no profile record

投稿

Gemini 2.5 Pro tops LiveBench, +6 pts overall over Claude 3.7 Sonnet Thinking

livebench.ai
1 ポイント·投稿者 ankeshanand·昨年·0 コメント

Gemini 1.5 Flash-8B

simonwillison.net
2 ポイント·投稿者 ankeshanand·2 年前·0 コメント

コメント

ankeshanand
·2 年前·議論
If you're an individual developer and not an enterprise, just go straight to Google AIStudio or GeminiAPI instead: https://aistudio.google.com/app/apikey. It's dead simple getting an API key and calling with a rest client.
ankeshanand
·2 年前·議論
We've done extensive comparisons against GPT-4V for video inputs in our technical report: https://storage.googleapis.com/deepmind-media/gemini/gemini_....

Most notably, at 1FPS the GPT-4V API errors out around 3-4 mins, while 1.5 Pro supports upto an hour of video inputs.
ankeshanand
·3 年前·議論
Has anyone in this subthread actually read the papers and compared the benchmarks? LLama2 is behind PALM-2 on all major benchmarks, I mean they spell this out in the paper explicitly.
ankeshanand
·7 年前·議論
There's active research in Model-Based RL right now that tries to tackle 1) and 2) together.