Ask HN: Is there any tool that can stop LLM calls at runtime (not just monitor)?3 points·by 8dazo·vor 3 Monaten·0 commentsI’ve been running into cases where LLM/agent systems make unexpected or repeated calls and costs spike quickly.Most tools I’ve found focus on observability (logs, traces, dashboards), but not actual enforcement.Is there anything that can:- stop or cut off a call mid-execution (based on budget, tokens, or conditions)?- enforce limits at runtime instead of just alerting after the fact?Curious if people here are solving this in practice, or just handling it at the application level.4 commentsPost comment[+]stratoatlas·vor 3 Monaten[+][deleted]·vor 3 Monaten[+]beyondscaletech·vor 3 Monaten[+]Leehunter0914·vor 3 Monaten
Most tools I’ve found focus on observability (logs, traces, dashboards), but not actual enforcement.
Is there anything that can:
- stop or cut off a call mid-execution (based on budget, tokens, or conditions)?
- enforce limits at runtime instead of just alerting after the fact?
Curious if people here are solving this in practice, or just handling it at the application level.