Stop comparing price per million tokens: the hidden LLM API costs(tensorzero.com)
tensorzero.com
Stop comparing price per million tokens: the hidden LLM API costs
https://www.tensorzero.com/blog/stop-comparing-price-per-million-tokens-the-hidden-llm-api-costs/
3 comments
I was surprised to learn that copilot is priced based on request, not token count. I've only used models through work before, so hadn't looked into how things are priced. So this is all somewhat new to me.
It's getting more and more challenging to keep track!