LLMCap – A proxy that hard-stops LLM API calls when you hit a dollar cap(llmcap.io)
llmcap.io
LLMCap – A proxy that hard-stops LLM API calls when you hit a dollar cap
https://www.llmcap.io/
24 comments
Proxying == Logging suspicions
guard-sdk does the same locally https://guard-sdk.js.org
guard-sdk does the same locally https://guard-sdk.js.org
Valid concern. Your provider API key is never stored — it passes through as a header on each request and is discarded immediately. LLMCap only stores token counts and costs per request. No key retention.
Its basic function is something you could vibe code in a few minutes :-)
Not to mention the whole privacy issue.
Not to mention the whole privacy issue.
I wonder much time did the author actually spent vibe coding this. I bet 90% of the time were spent on subscription payment processing.
I think the fundamental problem with this project is that if I'm on a hard budget, I have a hard time justifying $19–49/month to keep to my budget.
This will fail product-market fit instantly. Nobody is paying $49/mo for a tiny script they can vibe and run locally.
[deleted]
The pricing is very steep. I can see a market for this as an application with one time purchase but as a subscription?
Openrouter offers per API-key spending limits.
> The Service is provided "as is." We are not liable for downtime, data loss, or errors in token counting or cost calculation.
lmao
lmao
LiteLLM already provides this feature, no need of another proxy
i did try litellm hosted locally for privacy.
it was so bugged, the mcp page broke its postgres, many openai compatible type generic providers but not knowing what works. discovered logging was truncated by default, too late. my fault for that last one.
moved off it after the trivy incident.
it was so bugged, the mcp page broke its postgres, many openai compatible type generic providers but not knowing what works. discovered logging was truncated by default, too late. my fault for that last one.
moved off it after the trivy incident.
bifrost
Is this a joke project?
Even has a GUI.
$ uvx capit serve
https://github.com/day50-dev/limit-model-spending
* Free to use
* Everything is stored local.
* Anthropic skills are included for easily extending it to additional tools or providers.
Please ask for features or file bugs. Thanks!
Btw, I'm terrible at marketing even when I'm giving stuff away.