Type: url

Original: https://arxiv.org/pdf/2607.26819

Status: generated

Summary

This paper builds RepoComplianceBench, 106 issue instances from 49 open-source repositories whose written AI contribution rules fall into four types (Refuse, Disclose, Verify, Handoff), and tests whether four frontier coding agents discover and follow those rules while resolving an ordinary issue. Agents opened the relevant policy file in only 3.5% of unaided runs; disclosure and verification recovered to 77-100% with a reminder, the verbatim clause, or one round of feedback, while refusal and human handoff stayed near zero under every condition. The authors conclude that rules asking an agent to add a step can be met with existing mechanisms, but bans and human gates need enforcement outside the agent.

Generated pages