Type: url
Original: https://arxiv.org/pdf/2605.09252
Status: generated
Language: en
Summary
This preprint from UC San Diego introduces When2Tool, a benchmark of 18 environments across three categories of tool necessity (computational scale, knowledge boundaries, execution reliability) with easy, medium and hard levels, and shows that prompt-only and reason-then-act baselines give only coarse control over when LLM agents call tools. Probing pre-generation hidden states, the authors find tool necessity is linearly decodable (AUROC 0.89–0.96 across six models), and they propose Probe&Prefill, which uses a linear probe to prefill a steering sentence, cutting tool calls by 48% with 1.7% accuracy loss.