ericlippert

4년 전discuss

You have accurately re-stated the situation, yes. I know for a fact that there are teams like that! And what are they going to do now that the scientists who could have helped them make those decisions in a principled way are scattered to different teams or companies? This is the very definition of penny-wise and pound-foolish.

ericlippert

4년 전discuss

Thank you, that's kind of you to say!

ericlippert

4년 전discuss

I appreciate the sentiment behind your post, but in the future could we all please not conflate "neurodivergent people's difficulties in expressing empathy" with "being a jerk on the internet"?

I've had many gentle, kind, thoughtful and loving friends, classmates and coworkers who have lived with autism, and it's unfair and unkind to compare them to internet trolls. Thanks!

ericlippert

4년 전discuss

I was regretted attrition. And very, very far from the most vital person on my team.

ericlippert

4년 전discuss

People are leaving. In droves. There has been a huge exodus of senior talent in the last year. Zuck mentioned that in an earnings call and rather than assigning himself any responsibility said that those people were unregretted attrition and lazy parasites who were just collecting a paycheck during the pandemic. (I am paraphrasing somewhat; you can look it up if you want his exact words.)

Regarding change from within -- that's what a team dedicated to improving decision making is for.

ericlippert

4년 전discuss

We were a team of mathematicians focused on cost savings and improving decisions. We know how to subtract costs from benefits.

I was not the lead.

A team focused on helping the company make better decisions is all the more necessary when attempting a pivot.

ericlippert

4년 전discuss

I do have data to back this up for employees. You'd win that bet. Shareholders, I have no data on that.

ericlippert

4년 전discuss

Nor did anything compel you to read it, or post whiny comments here!

I did choose to work for Facebook. The pitch I was given seven years ago was that (1) the mission of the company is to lower costs of building community and connecting people; running an ad-funded social media platform is the means to that end. That's not a mission that is super important to me, but I can respect it. And (2) FB is the company that is investing heavily in advancing modern developer tools outside of the Microsoft ecosystem. That is a mission that is important to me.

Your statement that I wish I could continue to work for and enrich Zuck is false. I was regretted attrition.

Your lack of empathy is clear.

ericlippert

4년 전discuss

I am very thankful for that opportunity. I learned so much from my colleagues! And they were genuinely great people to work with.

I was well compensated, it's true. It's also true that for every $1000 I was paid, I lowered FB's costs by about $4000. The argument that I should be eternally grateful to Zuck for allowing me to keep a quarter -- before taxes! -- of the profit that accrued to him for writing zero lines of compiler code while he keeps the other three quarters is maybe not the strong argument you think it is.

ericlippert

4년 전discuss

Not the first time I've made that joke, but it's none the worse for having been used before.

ericlippert

4년 전discuss

I'm 100% sincere in that praise of my colleagues.

Many people, myself included, had a lot of concerns about the products the company was building and their effects on the world. When you work on a team whose mission is to help other teams make better decisions at lower cost, the aim is to look at the whole system and improve the whole thing.

Let me give you an example. Most "this content doesn't belong on FB" decisions are made by ML, but a great many go to human review. Imagine what that job is like. It's emotionally exhausting, it's poorly compensated, burnout is high.

My team had a model in production where we would use Bayesian reasoning to automatically detect when a particular human was likely to have made the correct decision about content classification, and therefore, if two humans disagreed, how to resolve that impasse without getting a third involved. (And in addition we get a lot more information out of the model including bounds on true prevalence of bad content, and so on.)

Does that save the company money? Sure. Millions of dollars a month. (And for the amateur bean counters elsewhere on this page: the data scientist who developed this model is NOT PAID MILLIONS OF DOLLARS A MONTH.) But it also (1) helps keep bad content off of the platform, so users aren't exposed to it, (2) lowers the number of human reviewers who come into contact with it, which is improves their jobs, and (3) frees up budget for whatever improvements need to be made to this whole workflow.

That's just one example; everything that we did was with an eye towards not merely saving the company money, but improving the ability to make good decisions about the products.

ericlippert

4년 전discuss

"Signal loss" is the overarching term for all the factors that lead to the company being less able to make good inferences about users. Not just the obvious consideration of "how do we serve an ad that is relevant to the user?" but for any data-driven decision that affects a user's experience.

The biggest recent cause of signal loss was Apple changing the rules for apps on their phone, but there are plenty of other causes.

The idea of a signal loss model is to identify ways to work around signal loss and still do a good job of making a decision with the data you have, when some of the data you were relying upon disappears suddenly.

ericlippert

4년 전discuss

That's all very kind of you to say, thank you.

I have several times been offered the chance to teach a masters level course on compiler design but never had the time to develop it. After a bit of a break, maybe I'll give that more thought.

ericlippert

4년 전discuss

And thanks to all the repliers below for their kind words. My goal was always to share knowledge and enthusiasm and it is genuinely touching to know that I succeeded.

ericlippert

4년 전discuss

I see your point and don't mean to be argumentative, but a couple small corrections.

First, the pivot to "meta" was just over a year ago, so it hasn't been quite years.

Second, I haven't been shy about sharing my opinion internally, though I haven't been broadcasting it either. The first thing I said in our team group chat when we'd heard this announcement was (context, I am much older than most people on the team) "I'm old enough to have read Snow Crash the week it came out and IT WAS A DYSTOPIA, why are we building it?"

Third, this opinion is indeed extremely common internally.

Fourth, I genuinely have no idea how this decision was made; it was certainly not on the basis of net cost savings. We did the math.

ericlippert

4년 전discuss

The team was all mathematicians. We did the math. I helped one of our data scientists put a model into production that saved $15M a year from that model alone, and we had a dozen people like that. We were working on signal loss models that had potential to save billions. I genuinely do not understand the logic of cutting this team to save costs.

ericlippert

4년 전discuss

Thank you, that's kind of you to say.

ericlippert

6년 전discuss

The question -- if sincerely asked -- is not rude.

My goal for this blog, which I have written for 17 years, is to write about algorithms, programming techniques, language design, and other stuff I find interesting. If you find it interesting too, consider subscribing.

The goal of this particular series, which should top out at 36 episodes, is to make a survey of different techniques for computing the Conway's Life automaton. The specific point I want to make in doing so is: the standard advice for optimization is to make a relatively naive implementation, profile, and then attack the slowest part by micro-optimizing it. Though this can be done in a principled manner, there are some algorithms where we can take advantage of facts about the "business domain" to craft much more performant algorithms than we could by simply finding small efficiencies in the inner loop. Life is definitely such an algorithm; there are opportunities for compression of both time and space that can lead to surprising performance optimizations.

My advice would be to start the series from the first episode rather than trying to start in the middle.

ericlippert

6년 전discuss

And that you would read it that way says more about you than it does about Tim, believe me.

ericlippert

6년 전discuss

It's not clear to me why you think that this anecdote had any particular intention. My intention was not to promote any position at all, but rather to tell an amusing personal story that I was reminiscing about because of an email I got from a young friend.

Anecdotes are by definition anecdotal; I am not promoting an anti-science position by relating a personal anecdote and I resent the statement that I am doing so.

If you'd like to write a blog article that promotes scientific thinking, I strongly encourage you to do so.