Skip to content

Question history lacked timing

What the user saw

The quiz recorded which questions had appeared, but not when they appeared, and answer choices stayed in their original order.

Why it happened

Question history stored only question numbers, and the quiz did not shuffle the displayed choices.

What the real fix did

The app now records when a question appeared and shuffles its choices in a stable order while keeping the correct answer linked.

This issue is worth 3 points: the real fix changed 380 source lines. Models fixed it in 21 of 22 recorded runs. The issue is in commit cb181b1 of the repository's git history and the real fix is commit 358ad4e. A model gets the code at the first commit and the repository's own tests decide if it fixed the issue.

Seen in