typon

3,862 karmajoined 17 tahun yang lalu

[ my public key: https://keybase.io/typon; my proof: https://keybase.io/typon/sigs/n3XfdbJqBTUy-IXBohwh-4TbEydnumleXWt7AsmXsIE ]

comments

kemarindiscuss

DinoV3 paper: https://arxiv.org/pdf/2508.10104#page=36

"we use a rough estimate of a total 9M GPU hours"

From CoreWeave, at current prices (~$2.46/hr spot to ~$6.16/hr on demand) would correspond to $22M–$55M.

The dataset is really where the cost is though - they used LVD-1689M - 1.6B images of curated web data from roughly 17B instagram images. This probably cost a huge amount of hours in human annotation, compute for algorithmic filtering, etc and not to mention probably a 20-50 person team working on this model.

You might want to change assumptions about how expensive these models are.

16 hari yang laludiscuss

I remember saving up for a year to buy the ATI Radeon 9600 XT (I think it was $200 MSRP) so I could play the game on high settings. Now we can play it inside a virtual machine on a crappy laptop. What a journey

bulan laludiscuss

Always pains me to see all this innovation and cool software work being applies towards making a machine that extracts money from retail investors and makes a few people extremely wealthy. What a depressing and colossal waste of time.

2 bulan yang laludiscuss

Actually I think AI will largely automate software and math and really not much else in the short to medium term. (speaking as a computer/math person)

2 bulan yang laludiscuss

Next time there is a fire at your house I will say "he's an adult who should have been careful playing with dangerous things like fire, we shouldnt waste society's money and resources on saving his house"

2 bulan yang laludiscuss

That part should be non negotiable - the tech companies should be funding the energy infrastructure. My bet is that they'd happily do it. They are starved for space and energy, not capital.

2 bulan yang laludiscuss

Can someone explain to me why local governments are so against datacenters? It seems like a golden opportunity to build electric infrastructure that's paid for by corporations and if AI is a bubble at least that infrastructure will remain and continue to provide cheap power.

3 bulan yang laludiscuss

https://imgur.com/a/dV8gk3R

can you find curves like this for any other power source?

also batteries are getting exponentially cheap too

3 bulan yang laludiscuss

What is the point of building energy outside of solar farms? I'm sincerely asking

3 bulan yang laludiscuss

And the reason for _that_ is because of the callous way American society accepts the deaths of thousands of people who die due to the Healthcare Industrial complex (of which Brian Thompson was a key member of). Just because those deaths don't happen with guns doesn't make them any less important.

4 bulan yang laludiscuss

[flagged]

4 bulan yang laludiscuss

You will be forced to watch Firefly for eternity. Millenials will rule the internet for a 1000 years (a millenia).

4 bulan yang laludiscuss

Like an oasis in a desert of LLM slop. Thanks I enjoyed this README

5 bulan yang laludiscuss

We will be old, not boomers. Boomers are a special generation at a special moment in world history - they made decisions based on the limited amount of knowledge they had about how the world works and while some think those decisions have doomed us forever, I remain optimistic.

5 bulan yang laludiscuss

Even though it feels depressing right now, I think the post-boomer world is going to be an amazing place.

6 bulan yang laludiscuss

Is this why Google Search has been getting better and better every year?

6 bulan yang laludiscuss

The website design and content are much nicer than the "ideas" here. Just standard LLM slop once if you actually have read some of these books.

7 bulan yang laludiscuss

https://en.wikipedia.org/wiki/WPS_Office

500 million users. Just because you haven't heard it doesn't mean an alternative doesn't exist.

7 bulan yang laludiscuss

ideally you should get a deduction in later years

8 bulan yang laludiscuss

have you considered not all ideas are good and maybe they shouldn't see the light of day?