They did not, Microsoft made the bet that there would be some application in the future that would require distribution to all developers. Turns out that application was Github Copilot.
Hi from the Codeium team. It's awesome to hear you are allowing other code LLMs to be used on the Replit platform (we're big fans)! We'd love to enable our free chrome extension on Replit.
We explicitly state in our privacy policy that we don't sell user data to third parties.
The language server is the common binary cross ides that actually processes local / repo context and communicates with the cloud service to generate completions. For now, that is closed source, similar to other tools like Tabnine and Copilot, but we may change that in the future.
Hi, Varun from the Codeium team here. This is fairly common thing to do to not support these sorts of domains to prevent abuse. Also, Copilot downloads a language server binary as well for their vim extension.
Sad, this whole thing where companies train chinchilla optimal models has to stop - I'm always happy to get open source models but it would be great if it was useful rather than a benchmark.
OpenAI has done the reasonable thing of not exposing the probability distribution per generated token so it's very hard to use that to completely map to their models. Ultimately, you still do need a very large base model to compete.
It isn't zero, that's for sure! Before Codeium, we as a team were building scalable ML infrastructure for some of the world's largest ML workloads, so we have a lot of experience in building infra (especially ML serving infra) that optimizes computation on GPUs/mixed compute resources to drastically reduce serving costs. We will probably talk more about these infra side optimizations in future blog posts!
I don't really want to argue but we have been pretty open about the fact that we want to keep this product free for users going forward as well. We have been pretty clear about our plan to monetize additional features but the focus now is to democratize this technology.
We are actively iterating on our data cleaning to deanonymize any user information. Of course some cases are tricky to find, but we recognize these issues are serious and will continue to work here. All of our training data is public, so we know that we won't ever produce private user info.
Elixir is not a language we are currently confident in, but in the very near future (O(weeks)), we believe we will have a model that is better than Copilot for Elixir and other niche languages.
We don't rely on any 3rd party APIs in order to keep serving costs down (which is necessary to keep this as a free service). We only use permissively licensed public code to train.
No the model actually runs remotely. We would love to have some way to run a lightweight model on the user's machines but it's just not feasible given model size and amount of computation required.