HackerTrans
TopNewTrendsCommentsPastAskShowJobs

fnbr

no profile record

Submissions

The Bitter Lesson

finbarr.ca
2 points·by fnbr·ano passado·0 comments

comments

fnbr
·há 8 meses·discuss
(I'm a researcher on Olmo.)

There's a bunch of other fully open models, including the [Marin](https://marin.community/) series of models out of Stanford and Nvidia regularly releases fully open models.
fnbr
·há 8 meses·discuss
MoEs have a lot of technical complexity and aren't well supported in the open source world. We plan to release a MoE soon(ish).

I do think that MoEs are clearly the future. I think we will release more MoEs moving forward once we have the tech in place to do so efficiently. For all use cases except local usage, I think that MoEs are clearly superior to dense models.
fnbr
·há 8 meses·discuss
(I’m a researcher on the post-training team at Ai2.)

Where did you try this? On the Ai2 playground?
fnbr
·há 8 meses·discuss
(I’m a researcher on the post-training team at Ai2.)

7B models are mostly useful for local use on consumer GPUs. 32B could be used for a lot of applications. There’s a lot of companies using fine tuned Qwen 3 models that might want to switch to Olmo now that we have released a 32B base model.
fnbr
·ano passado·discuss
Like what? All the examples people have said are where either

1) the company has Nx preferences, for N >1, in which case the company has essentially failed to fundraise or

2) the company sells for less than they raised, which again, is a polite form of failure.
fnbr
·ano passado·discuss
This is why I will never work somewhere with a short post termination exercise period (PTEP). If it’s not at least 5 years, ideally 10, they don’t seriously consider equity something that employees are owed.
fnbr
·ano passado·discuss
Can you explain? In most cases, preferences won’t come into play, assuming you raise at a standard 1x preference and sell for more than you have raised. In that case, owning 0.5% should roughly translate into $5M (modulo dilution).
fnbr
·há 3 anos·discuss
FAANGs aren’t anywhere near the high end of the ML job market currently.
fnbr
·há 3 anos·discuss
ML engineers work on products, AI research engineers work for AI research labs.

Skillset is almost identical, biggest difference is having research experience.
fnbr
·há 3 anos·discuss
Yes, 1000%. Especially when it comes to AI. Meta has an excellent team of ML engineers, many of whom are in exceptionally high demand right now. If I were a ML engineer at Facebook, _especially_ if I was working remotely, I'd be sending out a ton of applications right now. I bet they end up getting an easier, more meaningful, higher paying job.

I'm an AI research engineer who was recently laid off and this was my experience.
fnbr
·há 3 anos·discuss
Yeah. DeepMind has released various MCTS implementations (eg in OpenSpiel). Not the same as releasing AlphaZero.
fnbr
·há 13 anos·discuss
I believe that the above comment is misguided on a number of levels, especially the (assumed) bigoted nature of the writer, but first, note that in New York, one of the major American centers of the HIV/AIDS crisis (with the other being San Francisco), sodomy laws were only repealed by court order in 1980 [1], while AIDS was first clinically observed in America in 1981 [2].

Second, it is widely considered that the spread of HIV (which causes AIDS) was a result of (heterosexual) prostitution. If you look at [2], we see that it was spread extensively by African prostitutes from rural Congo, an almost uniquely heterosexual phenomenon.

[1] http://en.wikipedia.org/wiki/New_York_v._Onofre [2] http://en.wikipedia.org/wiki/HIV/AIDS#History