kernelsanderz

hace 5 mesesdiscuss

Theo’s snitch bench is a good data driven benchmark on this type of behavior. But in fairness the models are prompted to be bold to take actions. And doesn’t necessarily represent out of the box or models deployed in a user facing platform.

https://snitchbench.t3.gg/

kernelsanderz

hace 4 añosdiscuss

If you look at the dockerfile you can see that it’s copied from alice.py

comments