KaliBench: How a Cybersecurity Tool-Use Benchmark Exposes the Gap Between Agent Intent and Executable Commands

Security agents fail in a specific way: they understand what you want but cannot translate that intent into the exact command-line invocation required. KaliBench is a benchmark that measures this translation layer directly, without executing potentially dangerous security tools in a live…