DystopiaBench – Measuring AI's willingness to ruin humanity(dystopiabench.com)

8 pointsby mateianghel4 miesiące temu3 comments

DystopiaBench – Measuring AI's willingness to ruin humanity

https://dystopiabench.com/

3 comments

Made a benchmark inspired by the DoW vs Anthropic saga. Currently working on detailing the methodology more and doing a per prompt (no escalation) test run as well.

Let me know if you have suggestions / feedback.

barefootford4 miesiące temu

How long does it take to run this? How much is automated vs manual evals?

mateianghel4 miesiące temu

20-30 mins and 10-20 dollars. It's fully automated evals with Gemini 3 Flash as a judge, but I verified manually a lot of them and it grades the outputs reliably.