Show HN: Taliesin – bit-exact KV-cache restore, 21x faster, cross-GPU verified(medium.com)

Show HN: Taliesin – bit-exact KV-cache restore, 21x faster, cross-GPU verified

https://medium.com/@sietse_92846/a-big-chunk-of-ai-cost-is-just-the-model-re-reading-the-same-text-over-and-over-7b4d49821bd0

7 comments

markdaemenlast month

Real life solution for real life challenge.

Wetimelast month

Thanks, we work hard

Joakim__last month

Let's goo, this is awesome

Corbeniclast month

Thanks , We hope some pepople of yc also see this.

Luigi99last month

Super nice!

Corbeniclast month

Thank you , and thanks for the support , But we fear people of ycombinator did not see our apliation or did not see our progress. But thank you all kind works help us grow

Wetimelast month

Yes, thank you, it is technical so we get push back but we try to build something that all can benefit from