I agree with what you're saying.
I have a Claude plan for work and I prefer using Claude more than any other LLM I've tried.
Having recently tried the Codex 100€ plan with GPT-5.5 in high/xhigh, I don't think it's worse that the Opus models, just different.
I've noticed that depending on how you talk to it, you get wildly different outputs. This seems to happen less with Opus: it mostly understand what I want. GPT is often a bit too literal.
I added it in my oh-my-pi configuration before (it's OpenAI compatible), but Llama 3 8B is just absolutely unusable for anything coding related.
It is very fast and the latency is very good however.
Fyi, I believe `--flash-attn on` doesn't do anything, you should instead use `--flash-attn 1`.
I'm getting ~150t/s on a RTX 3080 10GB as well with f16 cache type.