HackerTrans
トップ新着トレンドコメント過去質問紹介求人

fnbr

no profile record

投稿

The Bitter Lesson

finbarr.ca
2 ポイント·投稿者 fnbr·昨年·0 コメント

コメント

fnbr
·8 か月前·議論
(I'm a researcher on Olmo.)

There's a bunch of other fully open models, including the [Marin](https://marin.community/) series of models out of Stanford and Nvidia regularly releases fully open models.
fnbr
·8 か月前·議論
MoEs have a lot of technical complexity and aren't well supported in the open source world. We plan to release a MoE soon(ish).

I do think that MoEs are clearly the future. I think we will release more MoEs moving forward once we have the tech in place to do so efficiently. For all use cases except local usage, I think that MoEs are clearly superior to dense models.
fnbr
·8 か月前·議論
(I’m a researcher on the post-training team at Ai2.)

Where did you try this? On the Ai2 playground?
fnbr
·8 か月前·議論
(I’m a researcher on the post-training team at Ai2.)

7B models are mostly useful for local use on consumer GPUs. 32B could be used for a lot of applications. There’s a lot of companies using fine tuned Qwen 3 models that might want to switch to Olmo now that we have released a 32B base model.
fnbr
·昨年·議論
Like what? All the examples people have said are where either

1) the company has Nx preferences, for N >1, in which case the company has essentially failed to fundraise or

2) the company sells for less than they raised, which again, is a polite form of failure.
fnbr
·昨年·議論
This is why I will never work somewhere with a short post termination exercise period (PTEP). If it’s not at least 5 years, ideally 10, they don’t seriously consider equity something that employees are owed.
fnbr
·昨年·議論
Can you explain? In most cases, preferences won’t come into play, assuming you raise at a standard 1x preference and sell for more than you have raised. In that case, owning 0.5% should roughly translate into $5M (modulo dilution).
fnbr
·3 年前·議論
FAANGs aren’t anywhere near the high end of the ML job market currently.
fnbr
·3 年前·議論
ML engineers work on products, AI research engineers work for AI research labs.

Skillset is almost identical, biggest difference is having research experience.
fnbr
·3 年前·議論
Yes, 1000%. Especially when it comes to AI. Meta has an excellent team of ML engineers, many of whom are in exceptionally high demand right now. If I were a ML engineer at Facebook, _especially_ if I was working remotely, I'd be sending out a ton of applications right now. I bet they end up getting an easier, more meaningful, higher paying job.

I'm an AI research engineer who was recently laid off and this was my experience.
fnbr
·3 年前·議論
Yeah. DeepMind has released various MCTS implementations (eg in OpenSpiel). Not the same as releasing AlphaZero.
fnbr
·13 年前·議論
I believe that the above comment is misguided on a number of levels, especially the (assumed) bigoted nature of the writer, but first, note that in New York, one of the major American centers of the HIV/AIDS crisis (with the other being San Francisco), sodomy laws were only repealed by court order in 1980 [1], while AIDS was first clinically observed in America in 1981 [2].

Second, it is widely considered that the spread of HIV (which causes AIDS) was a result of (heterosexual) prostitution. If you look at [2], we see that it was spread extensively by African prostitutes from rural Congo, an almost uniquely heterosexual phenomenon.

[1] http://en.wikipedia.org/wiki/New_York_v._Onofre [2] http://en.wikipedia.org/wiki/HIV/AIDS#History