Not Diamond — new SOTA meta-model(notdiamond.ai)
notdiamond.ai
Not Diamond — new SOTA meta-model
https://www.notdiamond.ai/
14 comments
I've been working with the team at Not Diamond and trying out the private beta for a couple of weeks, and the routing experience is great. It makes it really easy to use different models and also route based on different tradeoffs. All I had to do was grab API keys from the different LLM APIs and quickly set it up.
Thank you—really glad we could work together on this
Super cool to see this on HN. Saw Tomas demo an early version of it last year. Very neat work and the team behind it is brilliant.
Thanks Sami :) Has been awesome to be able to share our progress with you
Very nice, exactly what I have been looking for. Sign up was easy as well and I have it working in my personal project already.
Glad to hear that
Are computer vision models supported?
Not yet—very much on the roadmap though
[deleted]
this is neat, where can i find more details on how the automatic routing logic works?
Hey, thanks for checking it out! You can find some more info on how Not Diamond works here: https://notdiamond.readme.io/docs/how-not-diamond-works
To train a router, you literally just upload a dataset with your inputs and eval scores for different models. It’s completely agnostic to your choice of scoring metrics, frameworks, or tools. And if you don’t have your own eval data, you can still use Not Diamond’s base router out of the box—it takes <5m to set up.
Some other features worth noting:
• Python, TypeScript, and REST API support
• Option to route to faster/cheaper models when doing so doesn’t impact quality
• Joint prompt optimization interface
• Online, real-time personalization to hyperpersonalize model recommendations to individual end users
• Blazing fast inference speeds (<100ms)
• Easy deployments to your private infra
Would love to hear what folks think.