terafo · HackerTrans

6 maanden geledendiscuss

Dynamic libraries are a dumpster fire with how they are implemented right now, and I'd really prefer everything to be statically linked. But ideally, I'd like to see exploration of a hybrid solution, where library code is tagged inside a binary, so if the OS detects that multiple applications are using the same version of a library, it's not duplicated in RAM. Such a design would also allow for libraries to be updated if absolutely necessary, either by runtime or some kind of package manager.

terafo

7 maanden geledendiscuss

This article specifically talks about PC laptops and discusses changes in them.

terafo

7 maanden geledendiscuss

Having access to the text and being trained on the text are two different things.

terafo

7 maanden geledendiscuss

There are LLM's that can process 1 million token context window. Amazon Nova 2 for one, even though it's definitely not the highest quality model. You just put whole book in context and make LLM answer questions about it. And given the fact that domain is pretty limited, you can just store KV cache for most popular books on SSD, eliminating quite a bit of cost.

terafo

3 jaar geledendiscuss

Closer to 4 months. It is much better than having a bunch of 2-4gb models laying around.

terafo

4 jaar geledendiscuss

AFAIK Big.Little-like architectures weren't a thing in PC space only because of the scheduling problems, which is mostly a software limitation.

> I hope some competitors have written some related papers.

You should read this:) http://people.engr.tamu.edu/djimenez/pdfs/exynos_isca2020.pd...

terafo

4 jaar geledendiscuss

> but there really is some truth to that, isn't there?

There was an Arm version of AMD's Zen, it was called K12, but it never made it to the market since AMD had to choose their bets very carefully back then.

terafo

5 jaar geledendiscuss

Sites that do auto translate of original SO threads and pretend that it's their original content are the worst. Google sometimes prefers to give me that results instead of the actual SO thread because I'm not in English-speaking country. I have to waste some time to understand that it's just stolen SO thread. And it's not even that useful because some of them AUTO TRANSLATE CODE.

terafo

5 jaar geledendiscuss

>"Heavy" industry, pretty much by definition, means it's way cheaper to do it on Earth than in space

There are things that you just can't do on Earth because of gravity. And if price of putting things into orbit goes down it will open door to a lot of innovations in space manufacturing and within a decade it will have it's first "killer app". I can bet on it.

> no amount of rocket development will ever overcome those physics

This is simply not true. Your saying sounds like "Heavier than air flying machines are impossible". There's way more resources outside of our gravity well than inside of it and moving things from space to earth is cheaper than other way around. Yes, moving all heavy industry to space is complicated and very expensive, but it will be eventually done.

comments