Type: url
Original: https://arxiv.org/pdf/2410.02644
Status: generated
Summary
“Agent Security Bench (ASB): Formalizing and Benchmarking Attacks and Defenses in LLM-Based Agents” (Zhang, Huang, Mei, Yao, Wang, Zhan, Wang, Zhang; ICLR 2025) introduces ASB, a benchmark spanning 10 scenarios, 10 agents, over 400 tools, 27 attack/defense method types, and 7 evaluation metrics, and uses it to formalize and benchmark direct and indirect prompt injection, memory poisoning, a novel Plan-of-Thought backdoor attack, and mixed attacks against 13 LLM backbones, finding a highest average attack success rate of 84.30% and limited effectiveness among current defenses.