HackerTrans
TopNewTrendsCommentsPastAskShowJobs

FrancescoMassa

7 karmajoined 10 miesięcy temu

Submissions

Claude Savings with context caching awareness

github.com
2 points·by FrancescoMassa·20 godzin temu·1 comments

Save Claude Code Tokens with Smart Routing

github.com
11 points·by FrancescoMassa·8 dni temu·3 comments

Brick: SOTA LLM Routing

arxiv.org
3 points·by FrancescoMassa·25 dni temu·0 comments

comments

FrancescoMassa
·20 godzin temu·discuss
We have a new update for brick : with feedbacks from users we inserted context caching aware routing. so that savings are improved even if switching models transfers context from one kv cache to another. we introduced a tier1 compaction algorythm that makes the router cheaper while mantaining performances. Try it out with brick claude settings > cache aware routing > smartsqueeze
FrancescoMassa
·4 dni temu·discuss
[flagged]
FrancescoMassa
·7 dni temu·discuss
On our tests subagents & well used workflows are 20-30% more expensive for context & token efficiency
FrancescoMassa
·25 dni temu·discuss
[flagged]