microsoft/vscode benchmark card
microsoft/vscode: issues, models and the leaderboard with intervals, and a README badge.
1 public benchmark of this repository is listed. Together they hold 20 real issues from its git history, each proved by the repository's own tests. No run of them is published yet.
A coding agent gets the broken code and the issue report, has two tries per issue, and the tests of the repository decide whether the issue is fixed.
Repository: microsoft/vscode benchmark card