I have read a lot of the comments here and your article and I find this fascinating.
On controls and such:
on reddit someone pointed out that more prosocial people may be more likely to sign up but I believe you controlled for this using random assignment so I think you are good there.
The biggest thing, and I believe it has already been mentioned, is trying not to bias the raters. The best way fmpov being to pre-record interviews and play them to several different people.
The above would prevent testing for attrition but I think one variable at the time is the way to go. You could test attrition later by having ratings go a certain way and then seeing how subjects respond when they know that they interviewer knows their gender vs when they dont etc.
If you have any interest in trying to get this published academically, and I want to make sure you understand I am a very lowly research assistant, I could talk to some of the professors at my university to see if there is any interest.
The biggest thing, and I believe it has already been mentioned, is trying not to bias the raters. The best way fmpov being to pre-record interviews and play them to several different people.
The above would prevent testing for attrition but I think one variable at the time is the way to go. You could test attrition later by having ratings go a certain way and then seeing how subjects respond when they know that they interviewer knows their gender vs when they dont etc.
If you have any interest in trying to get this published academically, and I want to make sure you understand I am a very lowly research assistant, I could talk to some of the professors at my university to see if there is any interest.