Claude Savings with context caching awareness(github.com)
github.com
Claude Savings with context caching awareness
https://github.com/regolo-ai/brick-SR1
2 comments
We have a new update for brick : with feedbacks from users we inserted context caching aware routing. so that savings are improved even if switching models transfers context from one kv cache to another. we introduced a tier1 compaction algorythm that makes the router cheaper while mantaining performances. Try it out with brick claude settings > cache aware routing > smartsqueeze