HackerTrans
TopNewTrendsCommentsPastAskShowJobs

simonbutt

no profile record

Submissions

Evaluating Multimodal LLMs Using the Google IO 2024 Puzzle

hiresynth.ai
3 points·by simonbutt·vor 2 Jahren·2 comments

comments

simonbutt
·vor 2 Jahren·discuss
A couple weeks ago I rebuilt the https://hiresynth.ai landing page and docs using vitepress and was super impressed with the speed of implementation and how pretty it was by default.

Would recommend for any text heavy static site.
simonbutt
·vor 2 Jahren·discuss
While opensource models allow you to explore wider topics, I wonder how well mixtral holds context on longer exchanges?
simonbutt
·vor 2 Jahren·discuss
Wrote a post on multimodal LLMs (GPT-4V, Gemini Ultra, Claude3 Opus) attempting the puzzles at https://hiresynth.ai/blog/googleio_puzzle_multimodal_eval.ht.... Seems very easy for humans, far harder for LLMs currently
simonbutt
·vor 2 Jahren·discuss
GPT-4V, Claude 3 Opus and Gemini Ultra go head to head in solving GoogleIO Puzzle 2024
simonbutt
·vor 3 Jahren·discuss
This feels like the start of a lawsuit. If Tesla is state of the art and requires 5x less funding per charger than competition; what is the reasoning behind picking the competitors?