An arXiv study introduces RepoComplianceBench, testing coding agents against 106 issues from 49 open-source repositories with AI contribution rules and finding that the agents do not reliably follow bans, disclosure requirements, or human-signoff rules.
A First Look at Coding Agents' Compliance with AI Contribution Rules in Open-Source Communities
An arXiv study introduces RepoComplianceBench, testing coding agents against 106 issues from 49 open-source repositories with AI contribution rules and finding that the agents do not reliably follow bans, disclosure requirements, or human-signoff rules.
Source: Arxiv