HackerTrans
TopNewTrendsCommentsPastAskShowJobs

uluyol

no profile record

Submissions

Benchmarking LLMs on open source Vulkan

airlied.blogspot.com
2 points·by uluyol·12 mesi fa·0 comments

comments

uluyol
·2 mesi fa·discuss
What makes you think there was no competition?
uluyol
·3 mesi fa·discuss
Electricity? It's probably one of the best places in the world to have a solar+battery installation?
uluyol
·5 mesi fa·discuss
It just needs to be anything that will force OpenAI to IPO.
uluyol
·6 mesi fa·discuss
They count as a different type of failure.

We knew what to do but screwed up hard is a operational failure and we didn't plan for it is a design/planning failure.

The people who are hurt might not care, but understanding the root cause is important to address them.
uluyol
·7 mesi fa·discuss
Are these the current prices or the prices at the time the models were released?
uluyol
·12 mesi fa·discuss
They had contracts which forced them to buy Global Foundries even lasting into Zen 2 (I believe they used it with the IO die).
uluyol
·anno scorso·discuss
Layoffs might have to with what a person is working (project is no longer business priority, just cutting based on performance might lead to delays) or what team a person is working on (whole org gets the axe).
uluyol
·anno scorso·discuss
How is 1 false? Log improvement means for 10x the cost the model is 2x as good. For 100x the cost, the model is 3x as good.

Not a curve to be happy about TBH. You need to simultaneously find big efficiency wins and drive up costs substantially to get 4-5x improvements, and it is probably impossible to maintain good year on year improvements after the first 2-3 years when you get all the low hanging fruit.
uluyol
·2 anni fa·discuss
AMD is not ready to have a full announcement for their new consumer GPUs: https://morethanmoore.substack.com/p/where-was-rdna4-at-amds...
uluyol
·2 anni fa·discuss
Go stacks are dynamically copied and resized. Stack overflow is not a concern.
uluyol
·2 anni fa·discuss
I think the discussions in these threads show how accurate the framing of this article is. You have some people celebrating Google and friends (slowly) leaving the C++ ecosystem and those that continue to emphasize the flaws that have driven companies away from it in recent history (safety being #1) on the list.
uluyol
·2 anni fa·discuss
You might be interested in this talk: https://go.dev/blog/ismmkeynote
uluyol
·2 anni fa·discuss
Around the time the CoC was being established, Linus went to therapy. If I recall correctly, some people had spoke to him about his behaviors and he decided to do something about it. I think it was done in private so it's unclear how much of it was pressure vs his own decision. His tone has become much less aggressive since.
uluyol
·2 anni fa·discuss
Go very much is memory safe in the absence of data races.

Data races cause issues in all languages, though it's fair to say that Go is affected slightly more than languages like Java. Rust is a bit special by making data races hard to trigger (impossible in safe code IIUC), but this is not typical.
uluyol
·2 anni fa·discuss
Not sure early versions of rust is the best example of refcounting overhead. There are a bunch of tricks you can use to decrease that, and it usually doesn't make sense to invest too much time into that type of thing while there is so much flux in the language.

Swift is probably a better baseline.
uluyol
·4 anni fa·discuss
Link? This is upsetting if true.