# Natural-Language-to-CLI Translation

Researchers built KaliBench, a fine-grained benchmark for schema-free natural-language-to-CLI cybersecurity tool use on Kali Linux, containing 8,504 query-command pairs verified by LLM checking, sandboxed execution, and human review across 1,642 tools, 23 capability dimensions, and five security phases; evaluating 24 open-weight model configurations under unrestricted, restricted, and hinted settings, they found tool selection rises from 72.0% to 95.2% on average once candidates are constrained while optional-argument F1 barely moves, and only hints lift optional-argument F1 from 45.1% to 87.8% and Exact Correct from 22.3% to 73.

Researchers built KaliBench, a fine-grained benchmark for schema-free natural-language-to-CLI cybersecurity tool use on Kali Linux, containing 8,504 query-command pairs verified by LLM checking, sandboxed execution, and human review across 1,642 tools, 23 capability dimensions, and five security phases; evaluating 24 open-weight model configurations under unrestricted, restricted, and hinted settings, they found tool selection rises from 72.0% to 95.2% on average once candidates are constrained while optional-argument F1 barely moves, and only hints lift optional-argument F1 from 45.1% to 87.8% and Exact Correct from 22.3% to 73.