HackerTrans
TopNewTrendsCommentsPastAskShowJobs

FrancescoMassa

7 karmajoined vor 10 Monaten

Submissions

Claude Savings with context caching awareness

github.com
2 points·by FrancescoMassa·vor 19 Stunden·1 comments

Save Claude Code Tokens with Smart Routing

github.com
11 points·by FrancescoMassa·vor 8 Tagen·3 comments

Brick: SOTA LLM Routing

arxiv.org
3 points·by FrancescoMassa·vor 25 Tagen·0 comments

comments

FrancescoMassa
·vor 19 Stunden·discuss
We have a new update for brick : with feedbacks from users we inserted context caching aware routing. so that savings are improved even if switching models transfers context from one kv cache to another. we introduced a tier1 compaction algorythm that makes the router cheaper while mantaining performances. Try it out with brick claude settings > cache aware routing > smartsqueeze
FrancescoMassa
·vor 4 Tagen·discuss
[flagged]
FrancescoMassa
·vor 7 Tagen·discuss
On our tests subagents & well used workflows are 20-30% more expensive for context & token efficiency
FrancescoMassa
·vor 25 Tagen·discuss
[flagged]