HackerTrans
TopNewTrendsCommentsPastAskShowJobs

jonathanehrlich

no profile record

Submissions

A Crisis Merely Postponed

nytimes.com
3 points·by jonathanehrlich·4 mesi fa·0 comments

Reduce cache memory on avg 39x

twitter.com
2 points·by jonathanehrlich·anno scorso·1 comments

The Last Decision by the Leading Thinker on Decisions

wsj.com
4 points·by jonathanehrlich·anno scorso·2 comments

All-In Summit: Bill Gurley presents 2,851 Miles

youtube.com
7 points·by jonathanehrlich·3 anni fa·0 comments

Analysis: Part of China's economic miracle was a mirage. Reality check is next

reuters.com
7 points·by jonathanehrlich·3 anni fa·0 comments

Gump’s Store Owner Slams SF in Open Letter Complaining About Street Conditions

sfist.com
3 points·by jonathanehrlich·3 anni fa·2 comments

Flexport Founder Ryan Petersen Is VC Firm Founders Fund’s Newest Partner

forbes.com
2 points·by jonathanehrlich·3 anni fa·0 comments

Cuba to Host Secret Chinese Spy Base Focusing on U.S.

wsj.com
8 points·by jonathanehrlich·3 anni fa·1 comments

[untitled]

1 points·by jonathanehrlich·3 anni fa·0 comments

Stanford Hates Fun’: Students Revolt After Tree Mascot Suspension

wsj.com
9 points·by jonathanehrlich·4 anni fa·2 comments

Big Tech Is the West’s Surprise Weapon in Competition with Russia, China

wsj.com
6 points·by jonathanehrlich·4 anni fa·0 comments

Startup Markets, Summer 2022 Edition

blog.eladgil.com
1 points·by jonathanehrlich·4 anni fa·1 comments

[untitled]

1 points·by jonathanehrlich·4 anni fa·0 comments

America Is in Denial

theatlantic.com
43 points·by jonathanehrlich·4 anni fa·75 comments

Iran soared up to a scorching 52.2°C (126°F) today

twitter.com
56 points·by jonathanehrlich·4 anni fa·20 comments

Big water cutbacks ordered amid Colorado River shortage

latimes.com
131 points·by jonathanehrlich·4 anni fa·199 comments

[untitled]

1 points·by jonathanehrlich·4 anni fa·0 comments

Toronto is poised to become a producer of tech startups

techcrunch.com
205 points·by jonathanehrlich·10 anni fa·286 comments

comments

jonathanehrlich
·anno scorso·discuss
What if we trained a smaller KV cache for our documents offline? Using a test-time training recipe we call self-study, we find that this can reduce cache memory on avg 39x (enabling 26x higher tok/s and lower TTFT) while maintaining quality. These smaller KV caches, which we call cartridges, can be trained once and reused for different user requests!
jonathanehrlich
·4 anni fa·discuss
Thanks. Please write more frequently.
jonathanehrlich
·4 anni fa·discuss
Congrats Ryan!!! Huge hire!!