toml: 12 real bugs in Docker, 3 trials
Replays of toml: 12 real bugs in Docker, 3 trials: every model on every issue, side by side, with the result of each run.
Result
- Claude Haiku 5.5 fixed 4 of 12 issues and scored null of null points (27 min 50 s).
- GPT-6 Luna fixed 4 of 12 issues and scored null of null points (20 min 47 s).
Published 2026-11-15.
Issues in this video
- fix(display): Ensure all keys are encoded
- fix(serde): Deserialize Value datetimes into typed targets
- fix(writer): Don't overflow
- fix(edit): Don't allow moving tables above root
- fix(toml): Track dotted key for spans
- fix(parser): Error on table extension case
- fix(toml): Don't error on dotted keys extending implicit tables
- fix(parser): Report errors for `-_1`
- fix(parser): Improve error location for digit sep after prefix
- fix(parser): Be consistent about digit sep error
- fix(parser): Plug another whole in synthetic events
- fix(edit): On missing value, ensure a span is used