HackerTrans
TopNewTrendsCommentsPastAskShowJobs

jonathanehrlich

no profile record

Submissions

A Crisis Merely Postponed

nytimes.com
3 points·by jonathanehrlich·قبل 4 أشهر·0 comments

Reduce cache memory on avg 39x

twitter.com
2 points·by jonathanehrlich·السنة الماضية·1 comments

The Last Decision by the Leading Thinker on Decisions

wsj.com
4 points·by jonathanehrlich·السنة الماضية·2 comments

All-In Summit: Bill Gurley presents 2,851 Miles

youtube.com
7 points·by jonathanehrlich·قبل 3 سنوات·0 comments

Analysis: Part of China's economic miracle was a mirage. Reality check is next

reuters.com
7 points·by jonathanehrlich·قبل 3 سنوات·0 comments

Gump’s Store Owner Slams SF in Open Letter Complaining About Street Conditions

sfist.com
3 points·by jonathanehrlich·قبل 3 سنوات·2 comments

Flexport Founder Ryan Petersen Is VC Firm Founders Fund’s Newest Partner

forbes.com
2 points·by jonathanehrlich·قبل 3 سنوات·0 comments

Cuba to Host Secret Chinese Spy Base Focusing on U.S.

wsj.com
8 points·by jonathanehrlich·قبل 3 سنوات·1 comments

[untitled]

1 points·by jonathanehrlich·قبل 3 سنوات·0 comments

Stanford Hates Fun’: Students Revolt After Tree Mascot Suspension

wsj.com
9 points·by jonathanehrlich·قبل 4 سنوات·2 comments

Big Tech Is the West’s Surprise Weapon in Competition with Russia, China

wsj.com
6 points·by jonathanehrlich·قبل 4 سنوات·0 comments

Startup Markets, Summer 2022 Edition

blog.eladgil.com
1 points·by jonathanehrlich·قبل 4 سنوات·1 comments

[untitled]

1 points·by jonathanehrlich·قبل 4 سنوات·0 comments

America Is in Denial

theatlantic.com
43 points·by jonathanehrlich·قبل 4 سنوات·75 comments

Iran soared up to a scorching 52.2°C (126°F) today

twitter.com
56 points·by jonathanehrlich·قبل 4 سنوات·20 comments

Big water cutbacks ordered amid Colorado River shortage

latimes.com
131 points·by jonathanehrlich·قبل 4 سنوات·199 comments

[untitled]

1 points·by jonathanehrlich·قبل 4 سنوات·0 comments

Toronto is poised to become a producer of tech startups

techcrunch.com
205 points·by jonathanehrlich·قبل 10 سنوات·286 comments

comments

jonathanehrlich
·السنة الماضية·discuss
What if we trained a smaller KV cache for our documents offline? Using a test-time training recipe we call self-study, we find that this can reduce cache memory on avg 39x (enabling 26x higher tok/s and lower TTFT) while maintaining quality. These smaller KV caches, which we call cartridges, can be trained once and reused for different user requests!
jonathanehrlich
·قبل 4 سنوات·discuss
Thanks. Please write more frequently.
jonathanehrlich
·قبل 4 سنوات·discuss
Congrats Ryan!!! Huge hire!!