HackerTrans
TopNewTrendsCommentsPastAskShowJobs

jonathanehrlich

no profile record

Submissions

A Crisis Merely Postponed

nytimes.com
3 points·by jonathanehrlich·4 tháng trước·0 comments

Reduce cache memory on avg 39x

twitter.com
2 points·by jonathanehrlich·năm ngoái·1 comments

The Last Decision by the Leading Thinker on Decisions

wsj.com
4 points·by jonathanehrlich·năm ngoái·2 comments

All-In Summit: Bill Gurley presents 2,851 Miles

youtube.com
7 points·by jonathanehrlich·3 năm trước·0 comments

Analysis: Part of China's economic miracle was a mirage. Reality check is next

reuters.com
7 points·by jonathanehrlich·3 năm trước·0 comments

Gump’s Store Owner Slams SF in Open Letter Complaining About Street Conditions

sfist.com
3 points·by jonathanehrlich·3 năm trước·2 comments

Flexport Founder Ryan Petersen Is VC Firm Founders Fund’s Newest Partner

forbes.com
2 points·by jonathanehrlich·3 năm trước·0 comments

Cuba to Host Secret Chinese Spy Base Focusing on U.S.

wsj.com
8 points·by jonathanehrlich·3 năm trước·1 comments

[untitled]

1 points·by jonathanehrlich·3 năm trước·0 comments

Stanford Hates Fun’: Students Revolt After Tree Mascot Suspension

wsj.com
9 points·by jonathanehrlich·4 năm trước·2 comments

Big Tech Is the West’s Surprise Weapon in Competition with Russia, China

wsj.com
6 points·by jonathanehrlich·4 năm trước·0 comments

Startup Markets, Summer 2022 Edition

blog.eladgil.com
1 points·by jonathanehrlich·4 năm trước·1 comments

[untitled]

1 points·by jonathanehrlich·4 năm trước·0 comments

America Is in Denial

theatlantic.com
43 points·by jonathanehrlich·4 năm trước·75 comments

Iran soared up to a scorching 52.2°C (126°F) today

twitter.com
56 points·by jonathanehrlich·4 năm trước·20 comments

Big water cutbacks ordered amid Colorado River shortage

latimes.com
131 points·by jonathanehrlich·4 năm trước·199 comments

[untitled]

1 points·by jonathanehrlich·4 năm trước·0 comments

Toronto is poised to become a producer of tech startups

techcrunch.com
205 points·by jonathanehrlich·10 năm trước·286 comments

comments

jonathanehrlich
·năm ngoái·discuss
What if we trained a smaller KV cache for our documents offline? Using a test-time training recipe we call self-study, we find that this can reduce cache memory on avg 39x (enabling 26x higher tok/s and lower TTFT) while maintaining quality. These smaller KV caches, which we call cartridges, can be trained once and reused for different user requests!
jonathanehrlich
·4 năm trước·discuss
Thanks. Please write more frequently.
jonathanehrlich
·4 năm trước·discuss
Congrats Ryan!!! Huge hire!!