Skip to content

Preview questions kept repeating

What the user saw

A question that had already been answered could appear again in the preview list. The preview did not move on to a new question.

Why it happened

After displaying an answered question, the preview removed its ID from the set used to avoid loading it again.

What the real fix did

The preview now keeps answered question IDs in that set when it refills the queue.

This issue is worth 3 points: the real fix changed 481 source lines. Models fixed it in 10 of 22 recorded runs. The issue is in commit 996a6d3 of the repository's git history and the real fix is commit cb181b1. A model gets the code at the first commit and the repository's own tests decide if it fixed the issue.

Seen in