Type: url
Original: https://arxiv.org/abs/2508.14925
Status: generated
Summary
The arXiv abstract page for MCPTox, a benchmark for evaluating LLM agents’ robustness against tool poisoning, in which malicious instructions are embedded in a tool’s metadata on Model Context Protocol servers. Built on 45 live MCP servers and 353 authentic tools, it contains 1312 malicious test cases across 10 risk categories; evaluating 20 LLM agent settings, the authors report widespread vulnerability, with more capable models often more susceptible and refusal rates below 3%.