We Benchmarked Frontier LLMs on Defensive Security. The Results Surprised Us(cotool.ai)

6 pointsby logancarmody8 mesi fa2 comments

We Benchmarked Frontier LLMs on Defensive Security. The Results Surprised Us

https://cotool.ai/blog/evaluating-ai-agents-in-security-operations

2 comments

Interesting. I wonder if Gemini 3 reverses that performance trend or if the agent harness lended itself to OpenAI / Anthropic more than Google.

Would like to see this on more open-source agent harnesses and tools.

hunterwalk8 mesi fa

agreed - would be interesting