hugetim·vor 7 Monaten·discussContrary to what the leaderboard lists as the human score, their technical paper implies a human baseline of ~48%.
hugetim·vor 7 Monaten·discussAm I crazy to think these models have actually surpassed human performance on ARC 2? https://www.lesswrong.com/posts/DX3EmhmwZjTYp9PBf/ai-perform...