> I don't think anyone has a firm grasp on actual inference costs.
There are huge numbers of users (myself included) that do have an exact idea of what inference costs are - on open models. We can buy tokens from 3rd parties that have no motivation to subsidize our use. That's to say, there's a fair marketplace[1] and we're hanging out there.
If you want to say "I don't think anyone has a firm grasp on actual inference costs on these proprietary/closed models", then I could agree with that.
>Can I point it at a self-hosted / private DeepSeek endpoint?
>Yes. Since 0.30 we accept non-standard key prefixes for self-hosted DeepSeek endpoints. Just point `baseUrl` at your internal address — the loop, cache strategy, and tool protocol are unchanged.
But my question is:
If I use Reasonix to talk to a deepseek endpoint through openrouter, am I still getting the cache-hit benifits of this agent harness?
> What's the best way to use it with Pi, OpenRouter?
I can't claim it's "the best"...
But the Pi.dev and OpenRouter combo is what I'm doing at home, and I love it.
Setup was easy, I can use /model to switch between any of the openrouter models and whatever I'm hosting locally via VLLM.
I enjoy Rock Climbing, Go, Software Engineering, and Buddhism.
dilapidated homepage: https://slow.camp