ToolMisuseBench: A deterministic benchmark for tool-augmented Agents(huggingface.co)

1 pointsby akgitreposvor 4 Monaten2 comments

ToolMisuseBench: A deterministic benchmark for tool-augmented Agents

https://huggingface.co/datasets/sigdelakshey/ToolMisuseBench

2 comments

ToolMisuseBench is a deterministic, offline benchmark dataset for evaluating tool-using agents under realistic failure conditions, including schema misuse, execution failures, interface drift, and recovery under budget constraints.

This dataset is intended for reproducible evaluation of agent tool-use behavior, not for training a general-purpose language model.

akgitreposvor 4 Monaten

GitHub Repo: https://github.com/akgitrepos/toolmisusebench