HackerTrans
TopNewTrendsCommentsPastAskShowJobs

fnbr

no profile record

comments

fnbr
·8 maanden geleden·discuss
(I'm a researcher on Olmo.)

There's a bunch of other fully open models, including the [Marin](https://marin.community/) series of models out of Stanford and Nvidia regularly releases fully open models.
fnbr
·8 maanden geleden·discuss
MoEs have a lot of technical complexity and aren't well supported in the open source world. We plan to release a MoE soon(ish).

I do think that MoEs are clearly the future. I think we will release more MoEs moving forward once we have the tech in place to do so efficiently. For all use cases except local usage, I think that MoEs are clearly superior to dense models.
fnbr
·8 maanden geleden·discuss
(I’m a researcher on the post-training team at Ai2.)

Where did you try this? On the Ai2 playground?
fnbr
·8 maanden geleden·discuss
(I’m a researcher on the post-training team at Ai2.)

7B models are mostly useful for local use on consumer GPUs. 32B could be used for a lot of applications. There’s a lot of companies using fine tuned Qwen 3 models that might want to switch to Olmo now that we have released a 32B base model.
fnbr
·3 jaar geleden·discuss
Yeah. DeepMind has released various MCTS implementations (eg in OpenSpiel). Not the same as releasing AlphaZero.