Type: url
Original: https://arxiv.org/pdf/2504.15546
Status: generated
Summary
This paper presents a framework, developed by IBM Research, that adapts established REST API testing methods to evaluate whether enterprise APIs are “agent-ready” when wrapped as Python tools for LLM-based agents. It converts OpenAPI specifications into tool definitions, generates data-aware test cases using a tool dependency graph, translates them into natural-language utterances, and compares direct-tool-call execution against agent-driven execution to build a taxonomy of common tool-use errors. Applied to 189 enterprise tools across six applications (2,400+ test cases), the framework is deployed as part of IBM’s Watsonx Orchestrate Agent Development Kit (ADK).