From my first tests today, it is a workhouse. It can scan my whole code base, optimize every part, with a greater level of autonomy than other tools. This is insane, we are living at the best time.
It reminds me of the time where I deployed Gitea for self-hosting my git projects. In the end, nobody wanted to use it beyond myself. I would love to have a true federation protocol for Git, to decentralize the solution further.
It takes time and effort to build such benchmark. It works at Databricks scale, I'm not sure smaller companies are ready to invest on internal benchmarks.
But they are more vendor neutral, now they don't sell their own model. It's interesting from a benchmark point of view.
I wonder how Mistral will prioritize its robotic development against its LLM development. We have either players that prioritize both (Google, AMI), or players that prioritize coding and agentic (OpenAI, Anthropic, ...).
GitHub: https://github.com/fmind Portfolio: https://fmind.dev Blog: https://fmind.medium.com/ YouTube: https://www.youtube.com/@fmind-dev