HackerTrans
TopNewTrendsCommentsPastAskShowJobs

fertrevino

no profile record

Submissions

From GPT-4 to GPT-5: Measuring progress through MedHELM [pdf]

fertrevino.com
127 points·by fertrevino·11 เดือนที่ผ่านมา·96 comments

comments

fertrevino
·8 เดือนที่ผ่านมา·discuss
Trying to get the first commercial users for my digital menu management product: menuop.com

I have been working in ad campaigns and instrumentation to understand interest and reach out to potential users.
fertrevino
·10 เดือนที่ผ่านมา·discuss
I am rewriting my pet project: menuop.com . I am integrating AI in the whole restaurant menu creation process. Specifically I'm leveraging the Nano Banana to generate suitable images for food items.
fertrevino
·11 เดือนที่ผ่านมา·discuss
I wonder what exactly would prevent a developer from removing the signature from a generated file. One could remove arbitrary segments that signal that it is AI generated.
fertrevino
·11 เดือนที่ผ่านมา·discuss
'There seems to be a problem with your account. Please contact Github support' is what I get in my vscode extension.
fertrevino
·11 เดือนที่ผ่านมา·discuss
loved the cartoon :)
fertrevino
·11 เดือนที่ผ่านมา·discuss
That would be an interesting extension. MedGemma isn't part of the original benchmark either [1]. Since Gemini 2.0 Flash is on 6th place, expectations are for MedGemma to achieve higher than that :)

[1]https://crfm.stanford.edu/helm/medhelm/latest/#/leaderboard
fertrevino
·11 เดือนที่ผ่านมา·discuss
Mixed results indeed. While it leads the benchmark in two question types, it falls short in others which results in the overall slight regression.
fertrevino
·11 เดือนที่ผ่านมา·discuss
Interesting, it seems the anecdotal experience agrees with the benchmark results.
fertrevino
·ปีที่แล้ว·discuss
I find this topic more relevant as time goes by, I consider compliance and assessment of AI systems is necessary for its own success. I currently conduct a field study on the topic: https://www.ai-compliance.cloud/
fertrevino
·ปีที่แล้ว·discuss
I am extending my pet project menuop.com, a digital menu maker for restaurants. I plan to integrate AI to enhance visual impact, analytics and recommendations to restaurant owners.