Hi everyone! Fellow co-founder of NomadicML with Varun. We’re fascinated by auto optimization of complex ML systems, and the enterprise benefits it will yield.
Our innovative RL approach to optimize components of your ML systems (not only your LLM but also your RAG, guardrails, prompt tuner, etc…) in production is only but one benefit of the Nomadic Platform. Check out our SDK & Workspace for more!
Hi all, we've received a few questions offline on what type of developers can benefit the most from Nomadic's offerings. We believe the Nomadic SDK & Workspace can benefit a wide range of developers:
1. Solo ML practitioners looking to streamline their workflows,
2. MLEs in small to mid-size companies wanting FAANG-level capabilities,
3. Data science teams aiming to productionize models more efficiently,
4. Startups needing to quickly deploy ML features without a large engineering team.
Our goal is to provide tools that let any team serve high-quality ML features, regardless of size or resources. We're trying to bridge the gap between cutting-edge ML research and optimized, deployable solutions.
The Nomadic SDK supports 1st-party integrations with various open & closed-source ML/LLM providers. These are done through authenticated endpoints for interfacing securely with your models. Also, as noted in the Custom Evaluation section of our docs (https://docs.nomadicml.com/features/evaluations), you can provide your custom objective_functions and detail your model access logic, which may include custom authentication & access rules. A sample of this is present in our "Basic RAG" cookbook (link: https://colab.research.google.com/drive/1rv2f-qxgoN_eVDFu6Um...).
When integrated with the upcoming Nomadic Workspace, you can obtain your Nomadic API key and sync your local Nomadic models, experiments & experiment results with our managed service. The demo of this model/experiment/experiment result visualizatio is live at https:demo.nomadicml.com, please check it out and let us know your thoughts!
Our innovative RL approach to optimize components of your ML systems (not only your LLM but also your RAG, guardrails, prompt tuner, etc…) in production is only but one benefit of the Nomadic Platform. Check out our SDK & Workspace for more!