HackerTrans
TopNewTrendsCommentsPastAskShowJobs

zhug3

no profile record

Submissions

[untitled]

1 points·by zhug3·قبل 5 أشهر·0 comments

comments

zhug3
·قبل 5 أشهر·discuss
[dead]
zhug3
·قبل 5 أشهر·discuss
In my experience the biggest multiplier isn't any single variable it's the interaction between them. Fanout × retries × context growth compounds in ways that linear cost models completely miss.

The fix that worked for us: treat budget as a hard constraint, not a target. When you're approaching limit, degrade gracefully (shorter context, fewer tool calls, fallback to smaller model) rather than letting costs explode and cleaning up later.

Also worth tracking: the 90th percentile request often costs 10x the median. A handful of pathological queries can dominate your bill. Capping max tokens per request is crude but effective.
zhug3
·قبل 5 أشهر·discuss
The phrase "uncontrolled human experiment" is doing interesting rhetorical work here. It frames the status quo as the experiment and regulation as the control—when historically it's been the reverse.
zhug3
·قبل 5 أشهر·discuss
[dead]