ai-driven-dev-wiki
Search
Search
Dark mode
Light mode
Explorer
benchmarks
46 items with this tag.
Oct 16, 2026
"You're Right, Let Me Fix It": How LLM Agents Damage Correct Work When Falsely Accused
coding-agents
agent-safety
benchmarks
evaluation
Oct 16, 2026
UniToolCall: Unifying Tool-Use Representation, Data, and Evaluation for LLM Agents
agents
tool-use
evaluation
benchmarks
fine-tuning
Oct 16, 2026
A Tertiary Review of Large Language Model-Based Code Generating Tasks: Trends, Challenges, and Future Directions
code-generation
tertiary-review
evaluation
benchmarks
software-engineering
Oct 16, 2026
SWE-Review: Closing the Loop on Issue Resolution with Agentic Code Review
code-review
agents
benchmarks
Oct 16, 2026
SWE-Compass: Towards Unified Evaluation of Agentic Coding Abilities for Large Language Models
evaluation
agents
benchmarks
coding-agents
software-engineering
Oct 16, 2026
SWE-Bench+: Enhanced Coding Benchmark for LLMs
benchmarks
evaluation
coding-agents
Oct 16, 2026
SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains?
benchmarks
evaluation
coding-agents
multimodal
Oct 16, 2026
SWE-bench-java: A GitHub Issue Resolving Benchmark for Java
benchmarks
evaluation
coding-agents
software-engineering
Oct 16, 2026
A Comprehensive Survey on Benchmarks and Solutions in Software Engineering of LLM-Empowered Agentic System
agents
software-engineering
benchmarks
survey
Oct 16, 2026
SkillsBench: Benchmarking How Well Agent Skills Work Across Diverse Tasks
agent-skills
benchmarks
evaluation
Oct 16, 2026
NL2Repo-Bench: Towards Long-Horizon Repository Generation Evaluation of Coding Agents
coding-agents
benchmarks
long-horizon-tasks
Oct 16, 2026
MCPTox: A Benchmark for Tool Poisoning Attack on Real-World MCP Servers
mcp
security
agents
benchmarks
Oct 16, 2026
MCPToolBench++: A Large Scale AI Agent Model Context Protocol MCP Tool Use Benchmark
benchmarks
evaluation
tool-use
mcp
Oct 16, 2026
LoopsBench: From Harness Engineering to Loop Engineering in Coding Agent Evaluation
benchmarks
evaluation
coding-agents
loop-engineering
Oct 16, 2026
LLM Agents Making Agent Tools
agents
tool-use
benchmarks
evaluation
Oct 16, 2026
LLM Agents Already Know When to Call Tools - Even Without Reasoning
agents
tool-use
benchmarks
Oct 16, 2026
Instruction-Following Evaluation in Function Calling for Large Language Models
function-calling
benchmarks
evaluation
instruction-following
Oct 16, 2026
From Code Foundation Models to Agents and Applications: A Comprehensive Survey and Practical Guide to Code Intelligence
survey
code-llms
coding-agents
benchmarks
reinforcement-learning
Oct 16, 2026
FeatureBench: Benchmarking Agentic Coding for Complex Feature Development
benchmarks
evaluation
coding-agents
agentic-coding
Oct 16, 2026
Evaluation and Benchmarking of LLM Agents: A Survey
evaluation
benchmarks
llm-agents
survey
Oct 16, 2026
AgentJudgeBench: A Multi-Difficulty Benchmark for Evaluating LLM Judges on Agentic Tool-Calling
llm-as-a-judge
tool-use
benchmarks
evaluation
Oct 16, 2026
A Survey on Evaluation of LLM-based Agents
agents
evaluation
benchmarks
Oct 16, 2026
Solution Leakage
benchmarks
evaluation
Oct 16, 2026
Infrastructure noise
evaluation
benchmarks
agentic-coding
Oct 16, 2026
When2Tool
agents
tool-use
benchmarks
Oct 16, 2026
TM-Bench
benchmarks
evaluation
tool-use
Oct 16, 2026
τ-bench
agent-evaluation
benchmarks
tool-use
Oct 16, 2026
SWE-Review-Bench
code-review
benchmarks
agents
Oct 16, 2026
SWE-Compass
evaluation
agents
coding-agents
benchmarks
Oct 16, 2026
SWE-Bench+
benchmarks
evaluation
coding-agents
Oct 16, 2026
SWE-bench Multimodal
benchmarks
evaluation
coding-agents
multimodal
Oct 16, 2026
SWE-bench-java-verified
benchmarks
evaluation
coding-agents
software-engineering
Oct 16, 2026
SkillsBench
agent-skills
benchmarks
evaluation
Oct 16, 2026
ProjectDev
benchmarks
evaluation
code-generation
multi-agent
Oct 16, 2026
NL2Repo-Bench
coding-agents
benchmarks
long-horizon-tasks
Oct 16, 2026
MCPTox
mcp
security
benchmarks
Oct 16, 2026
MCPToolBench++
benchmarks
evaluation
tool-use
mcp
Oct 16, 2026
MCP-Bench
benchmarks
evaluation
tool-use
mcp
Oct 16, 2026
LoopsBench
benchmarks
evaluation
coding-agents
loop-engineering
Oct 16, 2026
IFEval-FC
function-calling
benchmarks
evaluation
instruction-following
Oct 16, 2026
FeatureBench
benchmarks
evaluation
coding-agents
Oct 16, 2026
EvoClaw
agents
benchmarks
Oct 16, 2026
CAVE-Bench
benchmarks
evaluation
coding-agents
agent-safety
Oct 16, 2026
AgentJudgeBench
llm-as-a-judge
tool-use
benchmarks
evaluation
Oct 16, 2026
Quantifying infrastructure noise in agentic coding evals
evaluation
benchmarks
agentic-coding
Oct 16, 2026
Measuring What Matters with Jules
agent-evaluation
agentic-coding
benchmarks