News
Artificial Analysis adds FrontierCode, a test of mergeable code changes
Cognition's FrontierCode 1.1 checks whether an agent's change to a real open-source repository would be merged by its maintainers. Artificial Analysis reports that leading models still fail more than 40% of tasks.
Sources
- Artificial AnalysisOriginal announcement
The headline and summary are ours; the facts come from the sources above. See how we verify.
Also tracked: All news · Usage reset tracker · All releases · Blog