Did they test whether GPT4 replicated already existing social science experiments? If so, this might have happened because the experiment was in the training data
I'm a programmer and data scientist. Using LLMs (specifically Claude 3.5 Sonnet) made me at least 10x as productive. I don't write boilerplate code anymore.