OpenAI's open language model is imminent(theverge.com)

9 pointsby thmanno scorso5 comments

OpenAI's open language model is imminent

https://www.theverge.com/notepad-microsoft-newsletter/702848/openai-open-language-model-o3-mini-notepad

6 comments

Thank you to Tom Warren (and The Verge) for specifying "open weight model" in paragraph two, and for going into more detail on what we know and don't know about what that means in paragraph nine.

> "OpenAI is preparing to announce the language model as an “open model,” but that terminology, which often gets confused with open-source, is bound to generate a lot of debate around just how open it is. That will all come down to what license is attached to it and whether OpenAI is willing to provide full access to the model’s code and training details, which can then be fully replicated by other researchers."

Legend2440anno scorso

'open source' isn't even a meaningful word for LLMs, since they don't have source code in the traditional sense.

vrighteranno scorso

yes they do. training code, dataset, and random seed. given all three, you can recreate the final model (the weights). The set of all three is the source code

lavoiemsanno scorso

That and random race conditions occurring during training.

herbstanno scorso

If I could theoretically fully rebuild it based on the given data I would call it open source. See the upcoming ETH model, it should be completely reproduceable

[deleted]anno scorso