ComputeBench: Instruction-following benchmarks for long, step-by-step arithmetic(notdian.github.io)

1 pointsby notdian7 เดือนที่ผ่านมา1 comments

notdian.github.io

ComputeBench: Instruction-following benchmarks for long, step-by-step arithmetic

https://notdian.github.io/computebench/

1 comments

notdian7 เดือนที่ผ่านมา

Vibecoded this after seeing models do amazing things but still drift on simple recursive steps; tracks exact match, answer accuracy, prefix correctness. Feedback welcome.