HackerTrans
TopNewTrendsCommentsPastAskShowJobs

fnbr

no profile record

Submissions

The Bitter Lesson

finbarr.ca
2 points·by fnbr·el año pasado·0 comments

comments

fnbr
·hace 8 meses·discuss
(I'm a researcher on Olmo.)

There's a bunch of other fully open models, including the [Marin](https://marin.community/) series of models out of Stanford and Nvidia regularly releases fully open models.
fnbr
·hace 8 meses·discuss
MoEs have a lot of technical complexity and aren't well supported in the open source world. We plan to release a MoE soon(ish).

I do think that MoEs are clearly the future. I think we will release more MoEs moving forward once we have the tech in place to do so efficiently. For all use cases except local usage, I think that MoEs are clearly superior to dense models.
fnbr
·hace 8 meses·discuss
(I’m a researcher on the post-training team at Ai2.)

Where did you try this? On the Ai2 playground?
fnbr
·hace 8 meses·discuss
(I’m a researcher on the post-training team at Ai2.)

7B models are mostly useful for local use on consumer GPUs. 32B could be used for a lot of applications. There’s a lot of companies using fine tuned Qwen 3 models that might want to switch to Olmo now that we have released a 32B base model.
fnbr
·el año pasado·discuss
Like what? All the examples people have said are where either

1) the company has Nx preferences, for N >1, in which case the company has essentially failed to fundraise or

2) the company sells for less than they raised, which again, is a polite form of failure.
fnbr
·el año pasado·discuss
This is why I will never work somewhere with a short post termination exercise period (PTEP). If it’s not at least 5 years, ideally 10, they don’t seriously consider equity something that employees are owed.
fnbr
·el año pasado·discuss
Can you explain? In most cases, preferences won’t come into play, assuming you raise at a standard 1x preference and sell for more than you have raised. In that case, owning 0.5% should roughly translate into $5M (modulo dilution).
fnbr
·hace 3 años·discuss
FAANGs aren’t anywhere near the high end of the ML job market currently.
fnbr
·hace 3 años·discuss
ML engineers work on products, AI research engineers work for AI research labs.

Skillset is almost identical, biggest difference is having research experience.
fnbr
·hace 3 años·discuss
Yes, 1000%. Especially when it comes to AI. Meta has an excellent team of ML engineers, many of whom are in exceptionally high demand right now. If I were a ML engineer at Facebook, _especially_ if I was working remotely, I'd be sending out a ton of applications right now. I bet they end up getting an easier, more meaningful, higher paying job.

I'm an AI research engineer who was recently laid off and this was my experience.
fnbr
·hace 3 años·discuss
Yeah. DeepMind has released various MCTS implementations (eg in OpenSpiel). Not the same as releasing AlphaZero.
fnbr
·hace 13 años·discuss
I believe that the above comment is misguided on a number of levels, especially the (assumed) bigoted nature of the writer, but first, note that in New York, one of the major American centers of the HIV/AIDS crisis (with the other being San Francisco), sodomy laws were only repealed by court order in 1980 [1], while AIDS was first clinically observed in America in 1981 [2].

Second, it is widely considered that the spread of HIV (which causes AIDS) was a result of (heterosexual) prostitution. If you look at [2], we see that it was spread extensively by African prostitutes from rural Congo, an almost uniquely heterosexual phenomenon.

[1] http://en.wikipedia.org/wiki/New_York_v._Onofre [2] http://en.wikipedia.org/wiki/HIV/AIDS#History