Skip to content

Careers reused the same answers

What the user saw

Questions for different careers could show the same generic answer choices. The choices did not reflect the work named in the question.

Why it happened

The question bank used a small shared set of answer phrases across many careers.

What the real fix did

The question response now builds answer choices around the career task or concept while keeping the correct answer in its marked position.

This issue is worth 3 points: the real fix changed 590 source lines. Models fixed it in 10 of 22 recorded runs. The issue is in commit b00f154 of the repository's git history and the real fix is commit 067517c. A model gets the code at the first commit and the repository's own tests decide if it fixed the issue.

Seen in