Show HN: Taliesin – bit-exact KV-cache restore, 21x faster, cross-GPU verified(medium.com)

10 ポイント投稿者 Wetime先月7 コメント

Show HN: Taliesin – bit-exact KV-cache restore, 21x faster, cross-GPU verified

https://medium.com/@sietse_92846/a-big-chunk-of-ai-cost-is-just-the-model-re-reading-the-same-text-over-and-over-7b4d49821bd0

7 コメント

markdaemen先月

Real life solution for real life challenge.

Wetime先月

Thanks, we work hard

Joakim__先月

Let's goo, this is awesome

Corbenic先月

Thanks , We hope some pepople of yc also see this.

Luigi99先月

Super nice!

Corbenic先月

Thank you , and thanks for the support , But we fear people of ycombinator did not see our apliation or did not see our progress. But thank you all kind works help us grow

Wetime先月

Yes, thank you, it is technical so we get push back but we try to build something that all can benefit from