ai-driven-dev-wiki
Search
Search
Dark mode
Light mode
Explorer
evaluation
96 items with this tag.
Oct 16, 2026
Better Harness
agent-tooling
coding-agents
harness-engineering
evaluation
open-source
Oct 16, 2026
"You're Right, Let Me Fix It": How LLM Agents Damage Correct Work When Falsely Accused
coding-agents
agent-safety
benchmarks
evaluation
Oct 16, 2026
Why Are Agentic Pull Requests Merged or Rejected? An Empirical Study
coding-agents
code-review
evaluation
empirical-study
Oct 16, 2026
Vibe Coding in Software Development: A Multivocal Literature Review
vibe-coding
evaluation
governance
human-ai-collaboration
survey
Oct 16, 2026
UniToolCall: Unifying Tool-Use Representation, Data, and Evaluation for LLM Agents
agents
tool-use
evaluation
benchmarks
fine-tuning
Oct 16, 2026
A Tertiary Review of Large Language Model-Based Code Generating Tasks: Trends, Challenges, and Future Directions
code-generation
tertiary-review
evaluation
benchmarks
software-engineering
Oct 16, 2026
SWE-Compass: Towards Unified Evaluation of Agentic Coding Abilities for Large Language Models
evaluation
agents
benchmarks
coding-agents
software-engineering
Oct 16, 2026
SWE-chat: Coding Agent Interactions From Real Users in the Wild
coding-agents
evaluation
vibe-coding
human-oversight
security
Oct 16, 2026
SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?
evaluation
coding-agents
llm
software-engineering
Oct 16, 2026
SWE-Bench+: Enhanced Coding Benchmark for LLMs
benchmarks
evaluation
coding-agents
Oct 16, 2026
SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains?
benchmarks
evaluation
coding-agents
multimodal
Oct 16, 2026
SWE-bench-java: A GitHub Issue Resolving Benchmark for Java
benchmarks
evaluation
coding-agents
software-engineering
Oct 16, 2026
SWE-bench: Can Language Models Resolve Real-World GitHub Issues?
evaluation
agents
llm
coding-agents
software-engineering
Oct 16, 2026
SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering
agents
coding-agents
llm
software-engineering
evaluation
Oct 16, 2026
From Question Answering to Task Completion: A Survey on Agent System and Harness Design
agent-architecture
evaluation
benchmarking
context-engineering
survey
Oct 16, 2026
StruQ: Defending Against Prompt Injection with Structured Queries
llm
security
prompt-injection
agent-safety
evaluation
Oct 16, 2026
Spec Kit Agents: Context-Grounded Agentic Workflows
spec-driven-development
agents
agent-architecture
evaluation
Oct 16, 2026
SkillsBench: Benchmarking How Well Agent Skills Work Across Diverse Tasks
agent-skills
benchmarks
evaluation
Oct 16, 2026
OpenHands: An Open Platform for AI Software Developers as Generalist Agents
agents
coding-agents
llm
software-engineering
evaluation
open-source
Oct 16, 2026
Multi-SWE-bench: A Multilingual Benchmark for Issue Resolving
evaluation
coding-agents
llm
software-engineering
reinforcement-learning
Oct 16, 2026
Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity
ai-assisted-programming
coding-tools
evaluation
Oct 16, 2026
MCPToolBench++: A Large Scale AI Agent Model Context Protocol MCP Tool Use Benchmark
benchmarks
evaluation
tool-use
mcp
Oct 16, 2026
MASAI: Modular Architecture for Software-engineering AI Agents
coding-agents
agent-architecture
software-engineering
evaluation
Oct 16, 2026
MarsCode Agent: AI-native Automated Bug Fixing
coding-agents
program-repair
multi-agent
evaluation
Oct 16, 2026
LoopsBench: From Harness Engineering to Loop Engineering in Coding Agent Evaluation
benchmarks
evaluation
coding-agents
loop-engineering
Oct 16, 2026
LLM Agents Making Agent Tools
agents
tool-use
benchmarks
evaluation
Oct 16, 2026
LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code
benchmark
code-generation
evaluation
data-contamination
Oct 16, 2026
Instruction-Following Evaluation in Function Calling for Large Language Models
function-calling
benchmarks
evaluation
instruction-following
Oct 16, 2026
Human-In-the-Loop Software Development Agents
coding-agents
human-oversight
multi-agent
evaluation
Oct 16, 2026
Grounding AI Agents in Contracts: An Empirical Evaluation of Spec-Driven Test Generation
spec-driven-development
agents
evaluation
Oct 16, 2026
From LLMs to LLM-based Agents for Software Engineering: A Survey of Current, Challenges and Future
agents
surveys
evaluation
Oct 16, 2026
FeatureBench: Benchmarking Agentic Coding for Complex Feature Development
benchmarks
evaluation
coding-agents
agentic-coding
Oct 16, 2026
Evaluation and Benchmarking of LLM Agents: A Survey
evaluation
benchmarks
llm-agents
survey
Oct 16, 2026
Position: Coding Benchmarks Are Misaligned with Agentic Software Engineering
benchmarking
evaluation
agent-harness
measurement-validity
Oct 16, 2026
Code Review Agent Benchmark
code-review
evaluation
agents
coding-agents
Oct 16, 2026
AutoCodeRover: Autonomous Program Improvement
agents
coding-agents
software-engineering
evaluation
Oct 16, 2026
Agentless: Demystifying LLM-based Software Engineering Agents
agents
coding-agents
llm
software-engineering
evaluation
Oct 16, 2026
AgentJudgeBench: A Multi-Difficulty Benchmark for Evaluating LLM Judges on Agentic Tool-Calling
llm-as-a-judge
tool-use
benchmarks
evaluation
Oct 16, 2026
Agentic Software Issue Resolution with Large Language Models: A Survey
agents
surveys
evaluation
reinforcement-learning
Oct 16, 2026
Agentic coding and persistent returns to expertise
agentic-coding
evaluation
human-ai-collaboration
Oct 16, 2026
A Survey on Evaluation of LLM-based Agents
agents
evaluation
benchmarks
Oct 16, 2026
A Survey of Code Review Benchmarks and Evaluation Practices in Pre-LLM and LLM Era
code-review
evaluation
llm
surveys
Oct 16, 2026
Value-Aware Agent Evaluation
evaluation
benchmarking
agent-architecture
deployment
Oct 16, 2026
Trustworthiness Dimensions
agents
agentic-engineering
evaluation
governance
Oct 16, 2026
Solution Leakage
benchmarks
evaluation
Oct 16, 2026
Output Verifiability
agentic-ai
sdlc
evaluation
industrial-adoption
Oct 16, 2026
Outdated Rate
code-review
metrics
evaluation
Oct 16, 2026
Jagged intelligence
llm
terminology
evaluation
human-oversight
Oct 16, 2026
Infrastructure noise
evaluation
benchmarks
agentic-coding
Oct 16, 2026
Harness Engineering
agent-architecture
evaluation
agent-tooling
Oct 16, 2026
Evidence-Centric Inspection
agents
human-oversight
code-review
evaluation
Oct 16, 2026
Digital Twin Universe
coding-agents
agents
evaluation
verification
agent-tooling
Oct 16, 2026
Data Contamination
benchmark
evaluation
Oct 16, 2026
Critic Model
coding-agents
verification
evaluation
Oct 16, 2026
Compositional Reliability
agents
evaluation
long-horizon-tasks
Oct 16, 2026
Code Review Task Taxonomy
code-review
evaluation
llm
Oct 16, 2026
Behavioral Evaluation
evaluation
harness-engineering
agent-architecture
Oct 16, 2026
Behavioral Drift
agents
evaluation
governance
Oct 16, 2026
Agent-Native Training
agent-architecture
training
evaluation
agent-state
Oct 16, 2026
Agent as a Judge
agents
code-review
evaluation
Oct 16, 2026
TM-Bench
benchmarks
evaluation
tool-use
Oct 16, 2026
Terminal-Bench
evaluation
agents
Oct 16, 2026
SWE-Compass
evaluation
agents
coding-agents
benchmarks
Oct 16, 2026
SWE-Bench
evaluation
agents
coding-agents
leaderboards
Oct 16, 2026
SWE-Bench Pro
evaluation
coding-agents
software-engineering
Oct 16, 2026
SWE-Bench+
benchmarks
evaluation
coding-agents
Oct 16, 2026
SWE-bench Multimodal
benchmarks
evaluation
coding-agents
multimodal
Oct 16, 2026
SWE-bench Lite-S
evaluation
coding-agents
software-engineering
Oct 16, 2026
SWE-bench-java-verified
benchmarks
evaluation
coding-agents
software-engineering
Oct 16, 2026
SkillsBench
agent-skills
benchmarks
evaluation
Oct 16, 2026
ProjectDev
benchmarks
evaluation
code-generation
multi-agent
Oct 16, 2026
Multi-SWE-bench
evaluation
coding-agents
software-engineering
Oct 16, 2026
MCPToolBench++
benchmarks
evaluation
tool-use
mcp
Oct 16, 2026
MCP-Bench
benchmarks
evaluation
tool-use
mcp
Oct 16, 2026
LoopsBench
benchmarks
evaluation
coding-agents
loop-engineering
Oct 16, 2026
LiveCodeBench
benchmark
code-generation
evaluation
data-contamination
Oct 16, 2026
IFEval-FC
function-calling
benchmarks
evaluation
instruction-following
Oct 16, 2026
FeatureBench
benchmarks
evaluation
coding-agents
Oct 16, 2026
CAVE-Bench
benchmarks
evaluation
coding-agents
agent-safety
Oct 16, 2026
c-CRAB
code-review
evaluation
agents
coding-agents
Oct 16, 2026
AgentJudgeBench
llm-as-a-judge
tool-use
benchmarks
evaluation
Oct 16, 2026
AACR-Bench
code-review
benchmark
evaluation
Oct 16, 2026
Writing effective tools for agents — with agents
tool-use
evaluation
context-engineering
agent-tooling
Oct 16, 2026
An update on recent Claude Code quality reports
claude-code
anthropic
coding-tools
evaluation
Oct 16, 2026
Testing Agent Skills Systematically with Evals
agent-skills
evaluation
coding-agents
Oct 16, 2026
Quantifying infrastructure noise in agentic coding evals
evaluation
benchmarks
agentic-coding
Oct 16, 2026
Learning to Verify AI-Generated Code
coding-agents
verification
evaluation
Oct 16, 2026
How we built our multi-agent research system
agent-architecture
evaluation
context-engineering
agent-tooling
Oct 16, 2026
How StrongDM's AI team build serious software without even looking at the code
coding-agents
agents
code-review
verification
evaluation
Oct 16, 2026
Harness design for long-running application development
agent-architecture
evaluation
long-horizon-tasks
agent-tooling
Oct 16, 2026
Closing the knowledge gap with agent skills
agent-skills
context-engineering
evaluation
agent-tooling
Oct 16, 2026
Building safeguards for Claude
agent-safety
evaluation
security
Oct 16, 2026
The Anatomy of Harness Engineering: How to Evaluate, Iterate, and Guard AI Coding Agents
evaluation
harness-engineering
agents
agent-architecture
Oct 16, 2026
AI 友好架构：DevOps 平台 & 平台工程赋能 AI 自动编程
coding-agents
context-engineering
agent-tooling
governance
evaluation
Oct 16, 2026
コーディングエージェントの実行過程を検証する Agent as a Judge をフィードバックループに導入する
agents
code-review
evaluation
Oct 16, 2026
A Fireside Chat with Cat and Thariq from the Claude Code team
coding-agents
agents
prompt-engineering
code-review
evaluation
agent-safety