They seem to be serving it at 3x the price while also struggling with maintaining uptime on openrouter; while the vercel router advertizes even bigger speeds but has no clear uptime stats
I guess you really do have to try it at least for some time to actually know
if you're not checking citations in the paper youre publishing AND trusting a non SOTA, hallucination prone ai model to come up with sources for it, its probably for the best of everyone that this paper isn't published.
yes there will be rare exceptions but in general i feel like this is a really good addition.
7b mistral is quite outdated. On a 12gb 4070 you can run qwen 3.5 9b q4km or qwen 3.6 35b, the latter will be a lot smarter but also a lot slower due to ram offload.
Try both in lm studio, they really are surprisingly capable
anthropic really needs to just make a great, personalized customer support experience where you get a couple dollars worth of opus credits that has some authority and ability to help with your issue.
"it couldnt be that simple because xyz" why not? I'm yet to see any big ai company actually try this
Great points. Using their printer "rooted" or with custom firmware seems like a decent compromise to me, kind of like what graphene is doing with pixels