HackerTrans
TopNewTrendsCommentsPastAskShowJobs

uluyol

no profile record

Submissions

Benchmarking LLMs on open source Vulkan

airlied.blogspot.com
2 points·by uluyol·12 months ago·0 comments

comments

uluyol
·2 months ago·discuss
What makes you think there was no competition?
uluyol
·3 months ago·discuss
Electricity? It's probably one of the best places in the world to have a solar+battery installation?
uluyol
·5 months ago·discuss
It just needs to be anything that will force OpenAI to IPO.
uluyol
·6 months ago·discuss
They count as a different type of failure.

We knew what to do but screwed up hard is a operational failure and we didn't plan for it is a design/planning failure.

The people who are hurt might not care, but understanding the root cause is important to address them.
uluyol
·7 months ago·discuss
Are these the current prices or the prices at the time the models were released?
uluyol
·12 months ago·discuss
They had contracts which forced them to buy Global Foundries even lasting into Zen 2 (I believe they used it with the IO die).
uluyol
·last year·discuss
Layoffs might have to with what a person is working (project is no longer business priority, just cutting based on performance might lead to delays) or what team a person is working on (whole org gets the axe).
uluyol
·last year·discuss
How is 1 false? Log improvement means for 10x the cost the model is 2x as good. For 100x the cost, the model is 3x as good.

Not a curve to be happy about TBH. You need to simultaneously find big efficiency wins and drive up costs substantially to get 4-5x improvements, and it is probably impossible to maintain good year on year improvements after the first 2-3 years when you get all the low hanging fruit.
uluyol
·2 years ago·discuss
Not sure early versions of rust is the best example of refcounting overhead. There are a bunch of tricks you can use to decrease that, and it usually doesn't make sense to invest too much time into that type of thing while there is so much flux in the language.

Swift is probably a better baseline.
uluyol
·4 years ago·discuss
Link? This is upsetting if true.