Did blind orchestra auditions benefit women?(statmodeling.stat.columbia.edu)
statmodeling.stat.columbia.edu
Did blind orchestra auditions benefit women?
https://statmodeling.stat.columbia.edu/2019/05/11/did-blind-orchestra-auditions-really-benefit-women/
122 comments
Why would blind auditions lower the average quality of female auditionees, and not male auditionees? That seems like searching for an explanation that fits a theory.
Worse, the authors acknowledge that blind auditions were part of a larger effort to recruit more women, but fail to account for other aspects of that effort. They simply attribute the entire effect to the blind auditions. But it seems likely that orchestras that were actively trying to recruit more women (like the NYPhil, which the paper claims increased the percentage of women in the orchestra from least in the nation to most) would have hired more women with or without blind auditions.
Original paper: https://www.nber.org/papers/w5903.pdf
Worse, the authors acknowledge that blind auditions were part of a larger effort to recruit more women, but fail to account for other aspects of that effort. They simply attribute the entire effect to the blind auditions. But it seems likely that orchestras that were actively trying to recruit more women (like the NYPhil, which the paper claims increased the percentage of women in the orchestra from least in the nation to most) would have hired more women with or without blind auditions.
Original paper: https://www.nber.org/papers/w5903.pdf
It might lower the average quality of female auditionees because you'd get females that aren't good enough to play in the orchestra, but told themselves that the only reason they weren't previously selected is because they're female. Males haven't been told "the only reason you weren't selected is because you're male", so you're not going to have less skilled males auditioning who think their sex is the only reason they didn't pass previous auditions.
Would you explanation work for example for sprinters (where men are objectively faster)? What does it tell about the quality of the explanation?
Orchestral skill isn't anywhere near as quantifiable as the time taken to sprint a given distance, so this comparison is irrelevant as far as I can see, though I welcome clarification.
The entire point is that there is no objective measure of playing ability, which allows conscious and subconscious biases to affect audition decisions, which is why blind auditions make sense for choosing orchestra performers, but is not required (let alone practical) for choosing sprinters.
The entire point is that there is no objective measure of playing ability, which allows conscious and subconscious biases to affect audition decisions, which is why blind auditions make sense for choosing orchestra performers, but is not required (let alone practical) for choosing sprinters.
It precisely the point that when we can easily measure results, it clear that the adhoc excuses in the grandparent comment are just that.
No, the point is that sprint times are judged by well-validated and understood instrumentation whose results are easily replicable. Conversely, the outcome of an orchestra audition is decided by human judges, and we know that humans are subject to conscious and unconscious biases that affect their ultimate decision.
We can easily measure the eventual decision of the audition, but the audition process itself is much more difficult to scrutinize, unlike your example of a sprint race. That's why your original challenge to compare this audition situation to a sprint race does not apply.
We can easily measure the eventual decision of the audition, but the audition process itself is much more difficult to scrutinize, unlike your example of a sprint race. That's why your original challenge to compare this audition situation to a sprint race does not apply.
You've missed the point. Perhaps, I've expressed it poorly. People see what they want to see.
> "One interpretation of this result is that the adoption of the screen lowered the average quality of female auditionees in the blind auditions. Only if we can hold quality constant can we identify the true impact of the screen."
There's something of a repeating theme lately. Study of blind interviews/tests in various fields => women found to underperform despite experimental controls and expectations => commentary and authors grasp at straws to explain the result with anything but the fact that perhaps men and women don't have the same performance envelope in every walk of life.
How many more of such studies and straw-grasping explanations will we have to go through before someone considers occam's razor?
There's something of a repeating theme lately. Study of blind interviews/tests in various fields => women found to underperform despite experimental controls and expectations => commentary and authors grasp at straws to explain the result with anything but the fact that perhaps men and women don't have the same performance envelope in every walk of life.
How many more of such studies and straw-grasping explanations will we have to go through before someone considers occam's razor?
> How many more of such studies and straw-grasping explanations will we have to go through
I don't follow. If GP's comment had ended with the bit you quoted then it might just be a straw-grasping explanation, but the rest of the comment says the study authors tested whether the explanation was true, and found that it was. That is, they suspected their result was due to sampling bias, found a bias in the data, and found that removing the bias reversed the result. If that's an accurate description of what happened, it doesn't sound much like grasping at straws.
I don't follow. If GP's comment had ended with the bit you quoted then it might just be a straw-grasping explanation, but the rest of the comment says the study authors tested whether the explanation was true, and found that it was. That is, they suspected their result was due to sampling bias, found a bias in the data, and found that removing the bias reversed the result. If that's an accurate description of what happened, it doesn't sound much like grasping at straws.
The first rule of experiment design is to state your hypothesis and controls upfront, and test only according to those. You don't get to update those parameters after the test is complete.
Failing to reject the null hypothesis but then saying 'if <alternative hypothesis picked with knowledge of result> is true then <result> would make sense' is not science. This claim is useless non-information after the results are known. This is a completely new claim that must be validated with a new study designed around it. Maybe this alternative hypothesis is true, maybe it isn't. Hindsight of the original experiment's data can never shed light on that.
Trying to pass off a revisionist hypothesis with advance knowledge of results, is very much grasping at straws. Reduced to the absurd, its as if someone predicted a coin flip would land on heads, and then revised their reasoning after seeing it land on tails and told you that their method of predicting coin flips was right all along except for that little <sampling bias/whatever>.
I hope this is clear and makes sense, because this is one of the fundamental pillars of the scientific method. You state a hypothesis, then you test, then you arrive at a conclusion. You don't start with a conclusion and then revise your hypothesis to match it after knowing the outcome of the test.
Failing to reject the null hypothesis but then saying 'if <alternative hypothesis picked with knowledge of result> is true then <result> would make sense' is not science. This claim is useless non-information after the results are known. This is a completely new claim that must be validated with a new study designed around it. Maybe this alternative hypothesis is true, maybe it isn't. Hindsight of the original experiment's data can never shed light on that.
Trying to pass off a revisionist hypothesis with advance knowledge of results, is very much grasping at straws. Reduced to the absurd, its as if someone predicted a coin flip would land on heads, and then revised their reasoning after seeing it land on tails and told you that their method of predicting coin flips was right all along except for that little <sampling bias/whatever>.
I hope this is clear and makes sense, because this is one of the fundamental pillars of the scientific method. You state a hypothesis, then you test, then you arrive at a conclusion. You don't start with a conclusion and then revise your hypothesis to match it after knowing the outcome of the test.
But they didn't update their experimental parameters after examining the data and results. They reported the results of their original study, found an interesting pattern, revisited the raw data to explore why this pattern might arise, and discussed the implications. As you point out, the natural next step would be to design a followup study that does control for the effect of knowing if auditions are blinded upon applicant quality. They're allowed and even obligated to discuss this "useless non-information," as you inaccurately describe it, in their paper. That's science.
That coin-flip prediction example seems incomplete to me. Here's how I would extend it to relate to the topic at hand: you ask a researcher to predict the distribution of heads and tails for a specific coin, which is secretly a trick coin with heads on both sides. The scientist trains a prediction algorithm on thousands of coin-flips performed on many randomly selected coins in the wild. Upon testing your coin, they find that 100% of the outcomes are heads, statistically very different from the training data (as confirmed by the appropriate statistical methods). You seem to advocate an uncritical reporting of this result, with no allowance for discussing possible explanations beyond the strict study flow of "predict 50% ± X% heads, flip coin N times, observe 100% heads, report result, end of story". A responsible scientist would discuss possible explanations for the anomalous result, including biased instrumentation, biased training data, biased sampling, uncontrolled variables, and so on.
Uncritically collecting data, grinding through statistical tests, and reporting p-values/effect sizes/confidence intervals is not science. Researchers are fully expected to interpret their results in the greater context of their field, while of course maintaining statistical rigour, which is necessary but not sufficient to do good science.
That coin-flip prediction example seems incomplete to me. Here's how I would extend it to relate to the topic at hand: you ask a researcher to predict the distribution of heads and tails for a specific coin, which is secretly a trick coin with heads on both sides. The scientist trains a prediction algorithm on thousands of coin-flips performed on many randomly selected coins in the wild. Upon testing your coin, they find that 100% of the outcomes are heads, statistically very different from the training data (as confirmed by the appropriate statistical methods). You seem to advocate an uncritical reporting of this result, with no allowance for discussing possible explanations beyond the strict study flow of "predict 50% ± X% heads, flip coin N times, observe 100% heads, report result, end of story". A responsible scientist would discuss possible explanations for the anomalous result, including biased instrumentation, biased training data, biased sampling, uncontrolled variables, and so on.
Uncritically collecting data, grinding through statistical tests, and reporting p-values/effect sizes/confidence intervals is not science. Researchers are fully expected to interpret their results in the greater context of their field, while of course maintaining statistical rigour, which is necessary but not sufficient to do good science.
[deleted]
> Trying to pass off a revisionist hypothesis with advance knowledge of results
I think you're reading too much into the "first they found X but then they found Y" narrative in the top comment of this thread. There's nothing like that in the actual paper - the authors start with one hypothesis, gather the data, do a bunch of regressions and whatnot, and report all the results. Then their overall conclusion is that the balance of the evidence supports their hypothesis, but they note all the caveats. There's no revisionism or changing of hypotheses or whatever, that I can see.
I think you're reading too much into the "first they found X but then they found Y" narrative in the top comment of this thread. There's nothing like that in the actual paper - the authors start with one hypothesis, gather the data, do a bunch of regressions and whatnot, and report all the results. Then their overall conclusion is that the balance of the evidence supports their hypothesis, but they note all the caveats. There's no revisionism or changing of hypotheses or whatever, that I can see.
Would you care to enlighten us with the truth?
They're suggesting that women, on average, just aren't as good as men at some things (and vice versa):
> perhaps men and women don't have the same performance envelope in every walk of life
> perhaps men and women don't have the same performance envelope in every walk of life
No, they are suggesting that the top performing women just aren't as good as the top performing men. A small but important difference.
I believe what they said is right. At the same time, I also believe that the worst performing men perform worse than the worst performing women - males have a wider spread of ability.
I believe what they said is right. At the same time, I also believe that the worst performing men perform worse than the worst performing women - males have a wider spread of ability.
even if the average might be the same, the tails of the distribution may differ
e.g., IQ distribution https://www.breitbart.com/politics/2015/10/02/sorry-girls-bu... (a man is more likely to be a fool or genius)
If you're trying to justify the practice of blind auditions, it might be better to target a different prejudice. Sexism may well not be a significant factor in hiring musicians today, but it's likely that other prejudices persist. Although it would be hard to quantify, if you could show that unattractive people or people who do not dress like typical musicians do better in blind auditions to a significant degree, then you might well have justified blind auditions.
This can be true, but orchestra is a performance act. If I look at it as a business, I don't see anything wrong in giving higher value to more attractive performers. On the other hand it's important how much higher value they get (and the multiple round audition when only one of the rounds is blind makes sense).
Hire a bunch of good looking actor models and let them pretend to play instruments while playing recorded music for maximum value.
That's essentially saying the orchestra should cater to the audience's prejudices, and could be used to justify any prejudice.
That's how entertainment industry works though?
Yeah but what is the point of having culture when it isn’t allowed to change views, give new perspectives and so on.
Also: Give me the best orchestra. I don’t go to the concert to gaze at a bunch of beuatiful penguins and ladies in dresses. I go there to listen to music. If they are good I don’t give a damn about their looks.
Also: Give me the best orchestra. I don’t go to the concert to gaze at a bunch of beuatiful penguins and ladies in dresses. I go there to listen to music. If they are good I don’t give a damn about their looks.
Visual appearance is indisputably part of the orchestral experience, otherwise they'd play out of sight (to reduce distractions from the audience) in comfortable clothing.
Well sonic waves travel with the line of sight, if you wanna get a direct signal, they will have to sit there either way. And you want to see them playing ans performing. Do they need to look really pretty to do that? Not necessarilly. Some of the best classical musicians are not beauties at all.
Indeed, if it doesn’t it doesn’t make any money and disappears unless it gets subsidies. So the WNBA and orchestras get subsidised and can have professionals whereas without subsidy their losses would force them out of existence in short order.
And orchestras do get subsidies because society feels they have value even if a cabaret would earn more money.
Certainly a segment of the entertainment industry earns money by catering to the worst aspects of human nature, but that's not the whole industry.
Certainly a segment of the entertainment industry earns money by catering to the worst aspects of human nature, but that's not the whole industry.
The majority of people involved in the industry are not visible to the audience.
[deleted]
> the orchestra should cater to the audience's prejudices
An orchestra must give the audience what the audience expects. Is just an expensive entertainment act.
An orchestra must give the audience what the audience expects. Is just an expensive entertainment act.
Well, what your typcal symphony orchestra audience wants is a mix of challenging (for the performs & listeners) pieces and the well-known standards. Stray too far either way and it's a miss.
It not just entertainment for a lot of people, unless you consider all cultural events "expensive entertainment acts".
It not just entertainment for a lot of people, unless you consider all cultural events "expensive entertainment acts".
For diverse values of "the audience."
The problem in real world is that anyone has a bias, there are people you instantly like or dislike and there is no objective thing so you end up liking people that are like you and reject people that are different.
An orchestra could be run that way, sure. But surely it's implicit that any orchestra that's interested in blind auditions is trying to do the exact opposite of what you've described.
Individual members of a classical orchestra are not really visible to the audience though. They're not necessarily hidden, but they're generally too far away for looks to matter very much (except possibly in cases of extreme disfiguration).
And even then the result can be mindblowing:
https://www.youtube.com/watch?v=6PyYcnXQZJY
Not exactly a classical orchestra, but it serves well to illustrate the point.
https://www.youtube.com/watch?v=6PyYcnXQZJY
Not exactly a classical orchestra, but it serves well to illustrate the point.
The difference between classical and jazz musicians points to a deeper conversation about diversity. Classical musicians are a cog in a big musical machine, so they are almost by definition less diverse. There's no room in a classical orchestra for a pianist who can't reach the far ends of the keyboard (Michel Petrucciani), there's no room for a guitarist with two-and-a-half working fingers on his fretting hand (Django Reinhardt), there's no room for a singer with a completely unique vocal range (Jimmy Scott).
Jazz is more amicable to diversity than classical music on a fundamental level, because it's based on improvisation and unique personal expression. If you're physically unable to play the same way as everyone else, you're pretty much useless to a classical orchestra but you may well become a pioneer in jazz.
Some obstacles to diversity can't be overcome with blind auditions and quotas and sensitivity training. Some environments are lacking in diversity because they are structurally incompatible with diversity; they can't have diversity retrofitted on to them, but need to be reformed from the ground up.
Jazz is more amicable to diversity than classical music on a fundamental level, because it's based on improvisation and unique personal expression. If you're physically unable to play the same way as everyone else, you're pretty much useless to a classical orchestra but you may well become a pioneer in jazz.
Some obstacles to diversity can't be overcome with blind auditions and quotas and sensitivity training. Some environments are lacking in diversity because they are structurally incompatible with diversity; they can't have diversity retrofitted on to them, but need to be reformed from the ground up.
Classical music is fine as it is, no need to change.
Why should being based on improvisation and unique personal expression be the be-all-and-end-all of analysis? Not everybody wants to play / hear improvised music.
Why should being based on improvisation and unique personal expression be the be-all-and-end-all of analysis? Not everybody wants to play / hear improvised music.
> Classical music is fine as it is, no need to change.
Classical music is dying, because the audience is literally dying of old age. Jazz or folk can sustain itself as a niche pursuit, because a small ensemble can profitably play to a small audience; a symphony orchestra has an enormous wage bill and has to fill a large hall week in and week out.
Classical music can renew itself and guarantee a sustained future, but it can't do it without fundamental structural reform. If classical musicians want a secure future for their art form, they need to seriously reflect on what classical music is, what it could be and what it needs to be. It's not enough to offer cheap tickets to under-30s, it's not enough to have the odd pops concert in the park - lip service will not abate an existential threat.
https://www.artsjournal.com/sandow/2011/03/age_of_the_audien...
Classical music is dying, because the audience is literally dying of old age. Jazz or folk can sustain itself as a niche pursuit, because a small ensemble can profitably play to a small audience; a symphony orchestra has an enormous wage bill and has to fill a large hall week in and week out.
Classical music can renew itself and guarantee a sustained future, but it can't do it without fundamental structural reform. If classical musicians want a secure future for their art form, they need to seriously reflect on what classical music is, what it could be and what it needs to be. It's not enough to offer cheap tickets to under-30s, it's not enough to have the odd pops concert in the park - lip service will not abate an existential threat.
https://www.artsjournal.com/sandow/2011/03/age_of_the_audien...
Classical music is alive and well in the form of film scores.
You make a good point.
Of course the justification fits to the sex differences as well. You should hire the gender that makes music performance more enjoyable for your audience.
In fact, maybe the goal should be to find how much gender bias is customer preference try to achieve that.
Of course the justification fits to the sex differences as well. You should hire the gender that makes music performance more enjoyable for your audience.
In fact, maybe the goal should be to find how much gender bias is customer preference try to achieve that.
But there is a chance you could skip some important judgement by doing blind auditions, for example if someone has sociopathic behaviors that will damage the orchestra team in the long run and that personality trait may have been clear in a face-to-face interview but not so much in a blind one.
Which you can establish by having a non-musical person (commonly HR person in tech) have an independent screening 1st phase interview.
In theory, such a person should be better suited to such evaluation too: it's not uncommon to have psychology majors in HR departments, for instance.
And finally, once you find someone is detrimenal to the team (the orchestra), you can still fire them (I know it might be harder).
In theory, such a person should be better suited to such evaluation too: it's not uncommon to have psychology majors in HR departments, for instance.
And finally, once you find someone is detrimenal to the team (the orchestra), you can still fire them (I know it might be harder).
If you have a non musical person doing a first - non-blind - screening, than the outcome of the all process becomes non-blind anyway.
That is very interesting. Art being compared to business. Should we censor talent to benefit the whole? This isn't a dev team with production deadlines... And yet, where do we draw the line? The artists know.
If you're a working artist then art is business. Most (all?) working artists make compromises in their art for business reasons IME. Professional artists IME (fine art, photography, ceramics) very much operate with production deadlines.
Why do "we" need to draw a line? I couldn't care less who they hire.
Must be pretty cool to able to identify sociopaths just by "lookin' them in the eye!"
The more I do interviews and get assigned the "culture & fit" asessment role, the more depressed I get. It's really just code for the bias "looks and acts like me => good"
The more I do interviews and get assigned the "culture & fit" asessment role, the more depressed I get. It's really just code for the bias "looks and acts like me => good"
Did no one follow up on this study since 2000? Presumably more blind auditions have taken place since then, and the basic problem seems to have been lack of data.
Perhaps it is a problem when the investigator’s entire career would be destroyed if they were to discover anything to contradict the zeitgeist of the field.
It seems to me that tenure was meant to solve this, but it doesn’t. Academics are groomed and selected to be career climbers, willing to sacrifice anything to please the gods of their establishment. 1000 years later, still a monastery.
It seems to me that tenure was meant to solve this, but it doesn’t. Academics are groomed and selected to be career climbers, willing to sacrifice anything to please the gods of their establishment. 1000 years later, still a monastery.
Honest question, how does it work if you are trying to have a good balance man/women in your team? Especially in IT trying to keep a good mix and avoid man only teams? Is this kind of advise even “safe” to ask these days?
The conjecture - in the article - is it doesn't work at, well at all is strong but certainly not to the degree that is claimed. Also, given the replication crisis in this field, any benefit is possibly noise.
By far the better approach than removing information by having blind / limited information applications is to have MORE information, e.g. https://marginalrevolution.com/marginalrevolution/2019/02/re...
> We conduct four randomized field experiments among 1,801 hosts on Airbnb by creating fictitious guest accounts and sending accommodation requests to them. We find that requests from guests with African American-sounding names are 19.2 percentage points less likely to be accepted than those with white-sounding names. However, a positive review posted on a guest’s page significantly reduces discrimination: When guest accounts receive a positive review, the acceptance rates of guest accounts with white-sounding and African American-sounding names are statistically indistinguishable.
By far the better approach than removing information by having blind / limited information applications is to have MORE information, e.g. https://marginalrevolution.com/marginalrevolution/2019/02/re...
> We conduct four randomized field experiments among 1,801 hosts on Airbnb by creating fictitious guest accounts and sending accommodation requests to them. We find that requests from guests with African American-sounding names are 19.2 percentage points less likely to be accepted than those with white-sounding names. However, a positive review posted on a guest’s page significantly reduces discrimination: When guest accounts receive a positive review, the acceptance rates of guest accounts with white-sounding and African American-sounding names are statistically indistinguishable.
I think it is fundamentally a question of culture. If you have too much of the same type, you will end up having a single dominant culture. If you have a more diverse team, no single culture might be dominant, which forces your team to develope a team culture on their own.
But this isn’t soley about race, nationality or gender, you have to find a good mix also in terms of personalities, skillsets etc. I always found system theory to be a useful abstraction when thinking about this. System theory asks the question which function a member of the system (the team) will take, given their personality etc. You cannot decide this from top down, it will just happen. Like in a family, where you can visit after 10 years and instantly, without beeing aware of it you put yourself into a certain position.
The question is: which function does a team/family member fulfill for the system?
A systemic view means the answer to this question depends on the constellation of the whole team and not just on individual members.
So my answer would be: make a team where everybody gets to align their personality with the function they will have within that social construct, make everybody a valuable part to the whole and make everybody realize, they are better off as a whole.
A good experienced team is like magic just because everybody precisely knows what their function within it is, and having a different background is part of these functions as well.
But this isn’t soley about race, nationality or gender, you have to find a good mix also in terms of personalities, skillsets etc. I always found system theory to be a useful abstraction when thinking about this. System theory asks the question which function a member of the system (the team) will take, given their personality etc. You cannot decide this from top down, it will just happen. Like in a family, where you can visit after 10 years and instantly, without beeing aware of it you put yourself into a certain position.
The question is: which function does a team/family member fulfill for the system?
A systemic view means the answer to this question depends on the constellation of the whole team and not just on individual members.
So my answer would be: make a team where everybody gets to align their personality with the function they will have within that social construct, make everybody a valuable part to the whole and make everybody realize, they are better off as a whole.
A good experienced team is like magic just because everybody precisely knows what their function within it is, and having a different background is part of these functions as well.
"But this isn’t soley about race, nationality or gender, you have to find a good mix also in terms of personalities, skillsets etc"
To my mind, this is the key point. It may be likely that a team with e.g. diverse skills/personalities will end up being gender diverse. But to assume that it has to be gender diverse, or that you can achieve a diversely skilled team by enforcing gender diversity seems to lapse into lazy gender stereotyping about how e.g. women's skills/perspectives are limited by their gender.
To my mind, this is the key point. It may be likely that a team with e.g. diverse skills/personalities will end up being gender diverse. But to assume that it has to be gender diverse, or that you can achieve a diversely skilled team by enforcing gender diversity seems to lapse into lazy gender stereotyping about how e.g. women's skills/perspectives are limited by their gender.
I think you have to try to seperate skill and background. If somebody has sufficient skill, you can decide based on their background. And then you should make a systemic decision: a new person affects the whole team, and how people distribute functions within the group. Bringing in the right person with a different background on the right spot can do wonders.
And by background I surely mean gender, but also things like educational background, nationality, personality etc.
Nobody should brute force for gender diversity just for the symbolic victory. Diversity done right has its benefits, but like all paradigms you have to use your brains when implementing it. Refusing to do so and then after a half assed attempt declaring it doesn’t work, is what you sadly witness quite often.
I know multiple women in tech and every single one of them had their gender used against them many times during their careers. Hiring men and women like in regular fields won’t hurt tech at all. I don’t really get why it has to be a big thing at all.
And by background I surely mean gender, but also things like educational background, nationality, personality etc.
Nobody should brute force for gender diversity just for the symbolic victory. Diversity done right has its benefits, but like all paradigms you have to use your brains when implementing it. Refusing to do so and then after a half assed attempt declaring it doesn’t work, is what you sadly witness quite often.
I know multiple women in tech and every single one of them had their gender used against them many times during their careers. Hiring men and women like in regular fields won’t hurt tech at all. I don’t really get why it has to be a big thing at all.
You seem to have missed my point. Gender is important to team balance only if we assume that someone's gender defines how they can contribute to a team. This assumption is lazy gender stereotyping. It is the very same assumption that hurts women's careers because people assume that women's contributions will be limited by their gender.
If you want someone who can contribute to a team in a certain way, then hire for that.
If you want someone who can contribute to a team in a certain way, then hire for that.
If someone has something you want you can offer them more money, whether what you want are skills or staff you’d have a beer with. Or you can offer them more attractive working conditions. If Posh Tom has to do half as much work as Pavel to get the same respect/promotions/money over time you’ll get more Posh Toms and fewer Pavels until your business is outcompeted.
In my opinion one should be seeking to hire the best person for the job every single time regardless of the person's race or gender. But I also believe that considering diversity needs is fair when tie-breaking between equally qualified candidates.
I've worked in IT for many years, and I've never even met two "equally qualified" people. How would you even determine such thing? Everyone has different amount of experience, different achievements, different grades in school, different skillsets.
You're exactly right, the exact level of qualification is impossible to quantify. Therefore, we can really only go with rough approximations; this person has experience in the field before, or has relevant education, or has done a lot of similar work before in hobby projects, or whatever.
From what I understand, the suggestion is that if one person is obviously more qualified than another, you pick the most qualified person regardless of other factors, but if there are multiple people where it's unclear who is better, you pick the person who's from a marginalized group.
If we had some kind of ultra-precise scientific way to measure a person's level of qualification, the point would be moot; it would be highly unlikely that two people would measure exactly the same, so we would never be in a situation where we choose based on other factors than qualifications. It's precisely because it's impossible to determine exactly how qualified someone is (probably by the very nature of what we mean by "qualified") that the idea has any merit at all.
From what I understand, the suggestion is that if one person is obviously more qualified than another, you pick the most qualified person regardless of other factors, but if there are multiple people where it's unclear who is better, you pick the person who's from a marginalized group.
If we had some kind of ultra-precise scientific way to measure a person's level of qualification, the point would be moot; it would be highly unlikely that two people would measure exactly the same, so we would never be in a situation where we choose based on other factors than qualifications. It's precisely because it's impossible to determine exactly how qualified someone is (probably by the very nature of what we mean by "qualified") that the idea has any merit at all.
It's hard enough to identify good or bad, let alone assess to the degree that I can say 2 candidates are comparable. When that happens it really means I've got an equally poor measure of both.
[deleted]
I think implicit in the parent's question is that a team might be better without you, even if you're the best person for the specific activities a candidate is being sought for.
That is: you want your team to succeed, but you'll accept a little less productivity if the team is fun, or there's less drama, or you feel happy being with your co-workers.
>considering diversity needs //
What are these needs?
I've struggled with this issue recently - in my kids school all the teaching staff are female. All the appointed governors are female too. So the people choosing the staff are females used to working in a female-only environment. There's no [visible or reported] effort to bias towards employing any men. I think not having any men in teaching roles, only the janitor is a man, is a bad thing for all the kids in the school. But, I don't really agree with "positive discrimination" as it's just discrimination and a woman who fails to get the job solely because of her sex would, IMO, be being unfairly discriminated against.
My sense is that the unfair discrimination is perhaps necessary, but it sits very uneasily with me.
To my mind this is the same sort of consideration, choosing a worse candidate because on a broader perspective, considering characteristics of the system rather than only the character, there's a benefit.
tl;dr systemic optimisation rather than local optimisation.
That is: you want your team to succeed, but you'll accept a little less productivity if the team is fun, or there's less drama, or you feel happy being with your co-workers.
>considering diversity needs //
What are these needs?
I've struggled with this issue recently - in my kids school all the teaching staff are female. All the appointed governors are female too. So the people choosing the staff are females used to working in a female-only environment. There's no [visible or reported] effort to bias towards employing any men. I think not having any men in teaching roles, only the janitor is a man, is a bad thing for all the kids in the school. But, I don't really agree with "positive discrimination" as it's just discrimination and a woman who fails to get the job solely because of her sex would, IMO, be being unfairly discriminated against.
My sense is that the unfair discrimination is perhaps necessary, but it sits very uneasily with me.
To my mind this is the same sort of consideration, choosing a worse candidate because on a broader perspective, considering characteristics of the system rather than only the character, there's a benefit.
tl;dr systemic optimisation rather than local optimisation.
A curious side note: Norway, often considered one of the most gender-equal countries in the world, has a law from 1978 called "the law of gender equality". The first section of the law states that the law is particularly intended to strengthen the position of women.
The systematic interpretation of this law is that it is legal to moderately discriminate in the favor of women when they apply for a position (school, work) that has a male majority, while it is illegal to discriminate in the favor of men when they apply for a position that has a female majority.
Examples of male-majority situations where this is applied is CEO or board positions in publicly-owned companies or engineering school, while examples of female-majority situations where this cannot be applied is veterinarian or medical school.
The systematic interpretation of this law is that it is legal to moderately discriminate in the favor of women when they apply for a position (school, work) that has a male majority, while it is illegal to discriminate in the favor of men when they apply for a position that has a female majority.
Examples of male-majority situations where this is applied is CEO or board positions in publicly-owned companies or engineering school, while examples of female-majority situations where this cannot be applied is veterinarian or medical school.
It's funny to think how these positive discriminations and the constant praise of the qualities intrinsic in being female, might stem from nothing else than the traditional sexist "gentleman" attitude towards the "weaker sex".
Isn’t it also a way to allow your team to get their own team culture instead of beeing steamrolled by the predominant culture?
I know this from film sets: I happend to be in crews, that were so diverse, that the only overlap in the end was that all of us somehow liked film. These were incredibly interesting and motivating crews, with a ton of creative ideas, willingness to go the extra length etc.
The worst crews I saw, were the ones where you had departments that had creepily aligned departments, that defined themselves by drawing a border to other departments. E.g. a light crew consisting completely out of white “dudes” all with the same ideas, jokes and taste, similar age etc. They did good work, but once they outnumbered the rest, the open discourse/exchange of ideas on set suffered.
I know this from film sets: I happend to be in crews, that were so diverse, that the only overlap in the end was that all of us somehow liked film. These were incredibly interesting and motivating crews, with a ton of creative ideas, willingness to go the extra length etc.
The worst crews I saw, were the ones where you had departments that had creepily aligned departments, that defined themselves by drawing a border to other departments. E.g. a light crew consisting completely out of white “dudes” all with the same ideas, jokes and taste, similar age etc. They did good work, but once they outnumbered the rest, the open discourse/exchange of ideas on set suffered.
> My sense is that the unfair discrimination is perhaps necessary, but it sits very uneasily with me.
But there are other ways to approach, and possibly fix, this problem. One would be increasing the reach, e.g. you could investigate if your job ads reach mostly women and instead advertise on some male-heavy media as well. Another would be fixing the underlying biases and misconceptions of the job (e.g. that teaching is a female job or that men that want to spend time with children are likely pedophiles) - though that one is obviously harder to do, you need society-wide influence. Or maybe you'd figure out that it's just the way it is, and there is a huge gender (or some other characteristic) imbalance in the whole pipeline (i.e. not just the applicants for the job, but already when people are applying to universities for the appropriate field of study) (in which case positive discrimination would mean you'd have to lower the bar to an unacceptable degree), which might be OK as well.
But there are other ways to approach, and possibly fix, this problem. One would be increasing the reach, e.g. you could investigate if your job ads reach mostly women and instead advertise on some male-heavy media as well. Another would be fixing the underlying biases and misconceptions of the job (e.g. that teaching is a female job or that men that want to spend time with children are likely pedophiles) - though that one is obviously harder to do, you need society-wide influence. Or maybe you'd figure out that it's just the way it is, and there is a huge gender (or some other characteristic) imbalance in the whole pipeline (i.e. not just the applicants for the job, but already when people are applying to universities for the appropriate field of study) (in which case positive discrimination would mean you'd have to lower the bar to an unacceptable degree), which might be OK as well.
Everyone is familiar with bro culture, but it seems odd and unrealistic to assume there's no female equivalent.
It's also odd that talk about the value of different perspectives and diversity can disappear as soon as some women create women-only workspaces for themselves.
It's examples like this that make me unfriendly to feminism. Equality of opportunity is a worthy goal, but either you support genuine diversity or you don't.
It's also odd that talk about the value of different perspectives and diversity can disappear as soon as some women create women-only workspaces for themselves.
It's examples like this that make me unfriendly to feminism. Equality of opportunity is a worthy goal, but either you support genuine diversity or you don't.
Let's pretend there is a human somewhere able "to hire the best person for the job every single time".
Presumably the best person for the job would be the one that maximizes the company's profit. Suppose it's easier to hire the female candidate that's better than all male candidates (hard as that might be to imagine for many on this site) if you currently have a woman working on the team. The existing team of eight high-performing men just isn't as appealing as a team of seven high-performing men and one not quite as high-performing woman.
Presumably the best person for the job would be the one that maximizes the company's profit. Suppose it's easier to hire the female candidate that's better than all male candidates (hard as that might be to imagine for many on this site) if you currently have a woman working on the team. The existing team of eight high-performing men just isn't as appealing as a team of seven high-performing men and one not quite as high-performing woman.
It's a great question to ask, and I hope you get some good advice here.
I think you need to hire the best people from your pool of candidates, regardless of gender. I think you need to build a process that minimizes bias, and anonymity is one good way to do that. I think if you're concerned about team diversity (and generally I think people should be concerned about that), you address it through outreach --- you address it at the top of your hiring funnel, not the bottom.
Why do you want to avoid "man only" teams?
This is not an easy topic to discuss here. What I can say is: 1) I have a good mix now and I like it but new hires are only males so it will change, this mix seems to work very well but I might be wrong here; 2) companies these days see it well and see it as “good” (being honest here)
Well, one reason is that once you get into the state of a male only team, it becomes significantly more difficult to recruit women.
I have heard from multiple women, that they will absolutely not join a team if they are the only woman on it.
You would miss out on a lot of talent that way.
I have heard from multiple women, that they will absolutely not join a team if they are the only woman on it.
You would miss out on a lot of talent that way.
Making software is about asking questions. You ask the questions necessary to figure out the best solution to a problem. If you have a "man only" team, or "anything only" really, you're less likely to have people asking different questions - they're all going to ask the same questions if they all have the same perspectives, biases, etc.
Diverse teams gather more information which leads to better insight of edge cases, and ultimately to better products.
Diverse teams gather more information which leads to better insight of edge cases, and ultimately to better products.
The problem with these threads is that many people make generalized and probably unfounded assumptions (like the one that is the topic of the article).
So in this case I do not see at all that software from "diverse" teams has gotten better.
I fact I think that overall software has gotten worse in the past decade. There is no structure, quality or documentation. The only thing that matters is that "something visible happens" so it resembles a product.
So in this case I do not see at all that software from "diverse" teams has gotten better.
I fact I think that overall software has gotten worse in the past decade. There is no structure, quality or documentation. The only thing that matters is that "something visible happens" so it resembles a product.
> Diverse teams gather more information which leads to better insight of edge cases, and ultimately to better products.
This is just an assertion currently, and I am not inclined to believe it is true. I would believe it for more "people" and/or culture oriented problems, such as catering, but for the majority of software development problems, diversity in people is nothing compared to diversity of software development experience. Which, ironically if we take as given most developers are white males, we maximise on average by only hiring white males!
This is just an assertion currently, and I am not inclined to believe it is true. I would believe it for more "people" and/or culture oriented problems, such as catering, but for the majority of software development problems, diversity in people is nothing compared to diversity of software development experience. Which, ironically if we take as given most developers are white males, we maximise on average by only hiring white males!
>Making software is about asking questions.
All that time I've wasted writing code...
All that time I've wasted writing code...
Code is the answers to the questions you've asked translated in to something a machine understands. If you're not asking the right questions your code is essentially worthless because your product won't do what the user actually wants. Hence software is about asking questions.
Hmm, it's a good idea, but it relies on men and women being fundamentally different (which I think they are) which goes directly against modern feminism.
If men and women are fundamentally different then there are good reasons to choose men or women only in a given situation (along normal stereotypes: women are better caregivers, men are better manual labourers).
Recruiting in this way is illegal in a lot of places.
>they're all going to ask the same questions if they all have the same perspectives, biases, etc. //
Then shoudln't you choose people based on their ability to consider the specific perspectives you need?
One of the things about people is the ability to adopt the perspective of others readily.
If men and women are fundamentally different then there are good reasons to choose men or women only in a given situation (along normal stereotypes: women are better caregivers, men are better manual labourers).
Recruiting in this way is illegal in a lot of places.
>they're all going to ask the same questions if they all have the same perspectives, biases, etc. //
Then shoudln't you choose people based on their ability to consider the specific perspectives you need?
One of the things about people is the ability to adopt the perspective of others readily.
I don’t think there is a widespread consesus within Feminism for the idea that women and men aren’t different — and honestly, everybody who says so didn’t bother to inform themselves.
Different genders/races/cultural backgrounds/educational backgrounds are connected to having different experiences in life. Of course you can imagine what e.g. sexism looks like, but when it happens to you every other day as a woman you will have it much more present than a man. Same thing with other aspects, people who have different racial/educational/cultural backgrounds bring different experiences with them and they might offer them precisely at the point where you didn’t think about it, not because you are a bad person, but because emulating all other perspectives your self is exhausting.
The variance between individuals of both genders and within races/nationalities/etc is big enough for you to look on the individual level. When you say “women are statistically on average better caregivers” and hire only women, not only are you missing out on very talented men, but the functionality of your team is reduced as well. E.g. because in some situation a male caregiver might be a better fit for a given client. Not because they are better or worse at their job, but because beeing male brings a whole set of experiences, cultural expectations etc with itself. The same apparently goes for other traits your employee might have.
Most jobs require teams to react to new and unpredictable challanges and having a broad range of backgrounds, helps them to always have a team member whi knows how to deal with it, because of their background ans life experience.
When you hire a team where you have a monoculture, it is hit or miss. It might work well for a certain job at a certain time, but if anything changes, your team might be less resilent, flexible and able to solve problems compared to a more diverse team.
Different genders/races/cultural backgrounds/educational backgrounds are connected to having different experiences in life. Of course you can imagine what e.g. sexism looks like, but when it happens to you every other day as a woman you will have it much more present than a man. Same thing with other aspects, people who have different racial/educational/cultural backgrounds bring different experiences with them and they might offer them precisely at the point where you didn’t think about it, not because you are a bad person, but because emulating all other perspectives your self is exhausting.
The variance between individuals of both genders and within races/nationalities/etc is big enough for you to look on the individual level. When you say “women are statistically on average better caregivers” and hire only women, not only are you missing out on very talented men, but the functionality of your team is reduced as well. E.g. because in some situation a male caregiver might be a better fit for a given client. Not because they are better or worse at their job, but because beeing male brings a whole set of experiences, cultural expectations etc with itself. The same apparently goes for other traits your employee might have.
Most jobs require teams to react to new and unpredictable challanges and having a broad range of backgrounds, helps them to always have a team member whi knows how to deal with it, because of their background ans life experience.
When you hire a team where you have a monoculture, it is hit or miss. It might work well for a certain job at a certain time, but if anything changes, your team might be less resilent, flexible and able to solve problems compared to a more diverse team.
> I don’t think there is a widespread consesus within Feminism for the idea that women and men aren’t different — and honestly, everybody who says so didn’t bother to inform themselves.
Apprently there is, otherwise why claim that any gender imbalance in the workplace must be the result of discrimination? I agree with you that diverse points of view can be useful; but diverse points of view imply (average) psychological and cultural differences, diverse attitudes and interests, and these might well be the reason of the gender imbalance. To use a steereotype (don't kill me for this) if female software developers can bring value to a team because on average they have a better eye for UX or design, then it is also probable that more females will be in UX or design than males, creating a gender imbalance in the number of candidates for software development positions.
Apprently there is, otherwise why claim that any gender imbalance in the workplace must be the result of discrimination? I agree with you that diverse points of view can be useful; but diverse points of view imply (average) psychological and cultural differences, diverse attitudes and interests, and these might well be the reason of the gender imbalance. To use a steereotype (don't kill me for this) if female software developers can bring value to a team because on average they have a better eye for UX or design, then it is also probable that more females will be in UX or design than males, creating a gender imbalance in the number of candidates for software development positions.
Feminism is a broad church. The point being made is that there isn't a consensus on the idea that "any gender imbalance in the workplace must be the result of discrimination". Many of the louder voices within the movement express this view but it's not a consensus.
> Apprently there is, otherwise why claim than any gender imbalance in the workplace must be the result of discrimination?
I don't think Feminists claim any gender imbalance in the workplace must be the result of discrimination. At least the ones I know usually hold much more balanced views here and the subset of them that is for a fixed quota of women in certain fields/levels usually also say, that they really don't think of this as a good solution, but as they unsucessfully atempted to change things using voluntary solutions for decades, they are now in favour of such solutions.
I am a European, so our feminist debate might differ from the one in the US. But you shouldn't listen to the ones screaming the loudest anywhere and think they are representative. If we'd judge white christians based on that it would mean the world would be filled with lunatics, when in fact it is much more nuanced.
> [...] then it is also probable that more females will be in UX or design than males [...]
I think nobody rational would argue agaisnt your thesis. The point feminists usually tend to make about this is, these bilogical tendencies are the only one thing that decides careers – there is also the question of work culture and sociatal expectations, etc.
If you do a little bit of research you will be fascinated how many women helped in the dawn of computation. This was, because before electronic computers, the word "computer" literally meant humans who did the calculations and these humans were predominantly female maths graduates in the dawn of the computer age. The job of a female computer was not well paid, only a fraction of what the male deciding mathematicians earned. But there weren't enough skilled people here, so women filled the position.
When computers became bigger, it started to become more male and the focus shifted from maths specialists to special degrees, the quality of software declined with the quality of education, more men started to work in the fields salaries increased, until at some point it was a male dominated field, with slight shifts in the recent years.
It is conviniently easy to say women are better at the thing they do at a specific point in history (which for some reason is always paid worse) and so they should just stick to it. E.g. today many women work in textiles and fashion, this was the polar opposite 150 years ago, yet today every unreflected person would swear that there is something inherently feminine about working in the textile industry. So IMO biological factors make a difference, but it has significantly more impact whether you live in a society that expects certain genders to fill certain roles. There will always be men or women that go against these roles, but wouldn't it be the best to live in a society where men are not expected to do/be/embody X and women not expected to do/be/embody Y? This would mean everybody could be closer to their true selves, and we end up with the best people for a given job.
In a practical setting the sensible and civilized stance to take on this is not to focus too much on gender and other features when deciding if somebody has the skill, while focusing on it when it is about the "systemic" question, whether somebody should be part of a team or not, with the goal of including people with different backgrounds.
I don't think Feminists claim any gender imbalance in the workplace must be the result of discrimination. At least the ones I know usually hold much more balanced views here and the subset of them that is for a fixed quota of women in certain fields/levels usually also say, that they really don't think of this as a good solution, but as they unsucessfully atempted to change things using voluntary solutions for decades, they are now in favour of such solutions.
I am a European, so our feminist debate might differ from the one in the US. But you shouldn't listen to the ones screaming the loudest anywhere and think they are representative. If we'd judge white christians based on that it would mean the world would be filled with lunatics, when in fact it is much more nuanced.
> [...] then it is also probable that more females will be in UX or design than males [...]
I think nobody rational would argue agaisnt your thesis. The point feminists usually tend to make about this is, these bilogical tendencies are the only one thing that decides careers – there is also the question of work culture and sociatal expectations, etc.
If you do a little bit of research you will be fascinated how many women helped in the dawn of computation. This was, because before electronic computers, the word "computer" literally meant humans who did the calculations and these humans were predominantly female maths graduates in the dawn of the computer age. The job of a female computer was not well paid, only a fraction of what the male deciding mathematicians earned. But there weren't enough skilled people here, so women filled the position.
When computers became bigger, it started to become more male and the focus shifted from maths specialists to special degrees, the quality of software declined with the quality of education, more men started to work in the fields salaries increased, until at some point it was a male dominated field, with slight shifts in the recent years.
It is conviniently easy to say women are better at the thing they do at a specific point in history (which for some reason is always paid worse) and so they should just stick to it. E.g. today many women work in textiles and fashion, this was the polar opposite 150 years ago, yet today every unreflected person would swear that there is something inherently feminine about working in the textile industry. So IMO biological factors make a difference, but it has significantly more impact whether you live in a society that expects certain genders to fill certain roles. There will always be men or women that go against these roles, but wouldn't it be the best to live in a society where men are not expected to do/be/embody X and women not expected to do/be/embody Y? This would mean everybody could be closer to their true selves, and we end up with the best people for a given job.
In a practical setting the sensible and civilized stance to take on this is not to focus too much on gender and other features when deciding if somebody has the skill, while focusing on it when it is about the "systemic" question, whether somebody should be part of a team or not, with the goal of including people with different backgrounds.
> which goes directly against modern feminism.
Not sure about what "modern feminism" is about, but the goal is fairness, which means treating women as women and not requiring male characteristics. Basically, detaching personality traits more common in one population (eg gender) from actual job requirements.
Not sure about what "modern feminism" is about, but the goal is fairness, which means treating women as women and not requiring male characteristics. Basically, detaching personality traits more common in one population (eg gender) from actual job requirements.
Back in the day, saying that an all female team of developers would be somehow deficient and would write inferior software would be seen as sexist.
The idea that this kind of a priori judgement is not only acceptable but laudible has come as a bit of a surprise.
Not least because it would seem to justify rejecting female applicants for a role where a 'male perspective' is considered important.
The idea that this kind of a priori judgement is not only acceptable but laudible has come as a bit of a surprise.
Not least because it would seem to justify rejecting female applicants for a role where a 'male perspective' is considered important.
Why do you think that all men have the same perspectives and biases?
Yeah because all men are completely the same.
Tech companies today seem more homogenous in thought and educational background than gender or race.
I'd invert this: why would a man-only team ever be a desirable situation? Normally if you have enough people, you should get fairly close to common ratio in numbers. If you end up with men only (or any X-only), it may be an indicator that there's something unhealthy about the company culture.
Following from that, it may be in your interest as a hiring person to bootstrap some diversity to remove that "unhealthy" idea early on.
Following from that, it may be in your interest as a hiring person to bootstrap some diversity to remove that "unhealthy" idea early on.
What is "common ratio"? Men only teams can actually have advantages. Mixed teams can have different advantages.
One advantage I could imagine is mixed teams making the company more attractive for men to work at, making it easier to attract talented developers.
One advantage I could imagine is mixed teams making the company more attractive for men to work at, making it easier to attract talented developers.
I meant ratio of available engineers in the market. Not as a specific number, but more of lacking any representation if you have 100+ employees.
Pay more. In general, women have a higher preference for ‘meaning’, ‘environment’, ‘flexibility’, ‘community’ or family. Your job offers none of that, so you have to pay a lot more to convince them to join your IT dungeon.
how does it work if you are trying to have a good balance man/women in your team?
Run a company that women see as a good place to work, where they won't be harassed and where they're treated fairly. Once the company gets a reputation for being a good place for women to work you'll get a lot more applications from women, and the problem of balance will resolve itself because you can hire on merit if you have a good selection of candidates.
The hard part will be firing people who do things that give the company a bad reputation even if they're great workers.
Run a company that women see as a good place to work, where they won't be harassed and where they're treated fairly. Once the company gets a reputation for being a good place for women to work you'll get a lot more applications from women, and the problem of balance will resolve itself because you can hire on merit if you have a good selection of candidates.
The hard part will be firing people who do things that give the company a bad reputation even if they're great workers.
In theory, that sounds about right. In practice, each smallish team will be culturally independent, and there won't be enough data to show off how equally your company is treating employees (or it will treat them all equally bad, but that's a different discussion). Let's remember that majority of the companies are small, and not everyone will go out of their way to publicly commend internal policies.
Just imagine a 20 person company with 5 women who are being fairly treated: how do they get better gender balance? Even if these five persons were outspoken, how many people could they reach? Not to mention that a true character of a company is only revealed in a crisis (harrasment, known unequal pay, role progression...). This company will never get the breadth of candidates Facebook might to be able to rely on statistics. Without actively pursuing that as a goal, balance never happens.
Positive gender discrimination is a societal tool, a tool to fix unfair social treatment of genders at an early age ("here are pink dolls for you dear, your brother can go play games on the computer" just as a blunt example, but it's a lot more subtle in general).
Just imagine a 20 person company with 5 women who are being fairly treated: how do they get better gender balance? Even if these five persons were outspoken, how many people could they reach? Not to mention that a true character of a company is only revealed in a crisis (harrasment, known unequal pay, role progression...). This company will never get the breadth of candidates Facebook might to be able to rely on statistics. Without actively pursuing that as a goal, balance never happens.
Positive gender discrimination is a societal tool, a tool to fix unfair social treatment of genders at an early age ("here are pink dolls for you dear, your brother can go play games on the computer" just as a blunt example, but it's a lot more subtle in general).
Most attempts to eliminate bias in IT hiring have resulted in reducing odds of being hired for women (eliminating bias by eliminating clues to the gender of the applicant, I mean). So if you want more women, you have to give them preferential treatment. Also, the pool is limited, so you are competing with the other firms for the few women available.
[deleted]
[deleted]
[deleted]
[deleted]
[deleted]
One such comment: "Table 4 presents the first results comparing success in blind auditions vs non-blind auditions. . . . this table unambigiously shows that men are doing comparatively better in blind auditions than in non-blind auditions. The exact opposite of what is claimed."
I had a look at the linked paper. And it is true that the table shows that women perform worse in blind auditions. However, the paper does not claim that this table shows that women perform better. Instead the paper elaborates on the options of why women perform worse by arguing the following:
"One interpretation of this result is that the adoption of the screen lowered the average quality of female auditionees in the blind auditions. Only if we can hold quality constant can we identify the true impact of the screen."
The paper goes on to explain how they discovered that during blind auditions there were a lot more under-qualified women and that this was skewing the data. They discovered this because they had the names of all the participants and saw that some women would participate in both blind and non-blind auditions while others would only participate in blind ones.
The following was the papers conclusion on this matter: "When we limit the sample to those who auditioned both with and without a screen, the success rate for women competing in blind auditions is almost always higher than in those that were not blind."