HackerTrans
TopNewTrendsCommentsPastAskShowJobs

jonathanehrlich

no profile record

Submissions

A Crisis Merely Postponed

nytimes.com
3 points·by jonathanehrlich·4 months ago·0 comments

Reduce cache memory on avg 39x

twitter.com
2 points·by jonathanehrlich·last year·1 comments

The Last Decision by the Leading Thinker on Decisions

wsj.com
4 points·by jonathanehrlich·last year·2 comments

All-In Summit: Bill Gurley presents 2,851 Miles

youtube.com
7 points·by jonathanehrlich·3 years ago·0 comments

Analysis: Part of China's economic miracle was a mirage. Reality check is next

reuters.com
7 points·by jonathanehrlich·3 years ago·0 comments

Gump’s Store Owner Slams SF in Open Letter Complaining About Street Conditions

sfist.com
3 points·by jonathanehrlich·3 years ago·2 comments

Flexport Founder Ryan Petersen Is VC Firm Founders Fund’s Newest Partner

forbes.com
2 points·by jonathanehrlich·3 years ago·0 comments

Cuba to Host Secret Chinese Spy Base Focusing on U.S.

wsj.com
8 points·by jonathanehrlich·3 years ago·1 comments

[untitled]

1 points·by jonathanehrlich·3 years ago·0 comments

Stanford Hates Fun’: Students Revolt After Tree Mascot Suspension

wsj.com
9 points·by jonathanehrlich·4 years ago·2 comments

Big Tech Is the West’s Surprise Weapon in Competition with Russia, China

wsj.com
6 points·by jonathanehrlich·4 years ago·0 comments

Startup Markets, Summer 2022 Edition

blog.eladgil.com
1 points·by jonathanehrlich·4 years ago·1 comments

[untitled]

1 points·by jonathanehrlich·4 years ago·0 comments

America Is in Denial

theatlantic.com
43 points·by jonathanehrlich·4 years ago·75 comments

Iran soared up to a scorching 52.2°C (126°F) today

twitter.com
56 points·by jonathanehrlich·4 years ago·20 comments

Big water cutbacks ordered amid Colorado River shortage

latimes.com
131 points·by jonathanehrlich·4 years ago·199 comments

[untitled]

1 points·by jonathanehrlich·4 years ago·0 comments

Toronto is poised to become a producer of tech startups

techcrunch.com
205 points·by jonathanehrlich·10 years ago·286 comments

comments

jonathanehrlich
·last year·discuss
What if we trained a smaller KV cache for our documents offline? Using a test-time training recipe we call self-study, we find that this can reduce cache memory on avg 39x (enabling 26x higher tok/s and lower TTFT) while maintaining quality. These smaller KV caches, which we call cartridges, can be trained once and reused for different user requests!
jonathanehrlich
·4 years ago·discuss
Thanks. Please write more frequently.
jonathanehrlich
·4 years ago·discuss
Congrats Ryan!!! Huge hire!!