Self-contained static site generated by gen-site.sh from telemetry-512qa-multi/runs/*/summary.json. Wall times marked (derived) are reconstructed, not measured. Click a config for its per-domain breakdown — or skip the spreadsheet and read the highlights (pass 1) or independent top 10 (pass 2).
| config | lane | model | ok | fail | expected | completion | wall_s | mutations ok/total | flags |
|---|---|---|---|---|---|---|---|---|---|
| sol-fast-titanium | sekhmet | gpt-5.6-sol | 544 | 0 | 512 | 106.3% | 3009s | 32/32 | — |
| grok-4.6-low | grok | grok-4.6 | 536 | 16 | 512 | 104.7% | ~493s (derived) | 24/40 | — |
| grok-4.6-high | grok | grok-4.6 | 515 | 13 | 512 | 100.6% | ~848s (derived) | 6/16 | — |
| luna-fast-titanium | sekhmet | gpt-5.6-luna | 512 | 32 | 512 | 100% | 2296s | 0/32 | — |
| glm-5.3 | opencode | opencode-go/glm-5.3 | 507 | 6 | 512 | 99% | 3538s | 1/1 | — |
| ox-alpha-free | opencode | opencode-go/ox-alpha-free | 267 | 7 | 273 | 97.8% | 2367s | 1/1 | — |
| ds-pro-0813 | tp | alibaba-token-plan/deepseek-v4-pro-0813 | 397 | 83 | 445 | 89.2% | 3295s | 0/35 | — |
| ds-flash-0731 | tp | alibaba-token-plan/deepseek-v4-flash-0731 | 445 | 107 | 512 | 86.9% | 1478s | 0/40 | — |
| qwen3.8-max-low | qwen38 | qwen3.8-max | 416 | 15 | 512 | 81.3% | ~908s (derived) | 0/0 | incomplete |
| grok-4.6-default | grok | grok-4.6 | 399 | 1 | 512 | 77.9% | ~735s (derived) | 0/0 | incomplete |
| hy3-free | opencode | opencode/hy3-free | 350 | 158 | 508 | 68.9% | ~241s (derived) | 0/0 | — |
| mimo-v2.5-free | opencode | opencode/mimo-v2.5-free | 291 | 156 | 447 | 65.1% | ~331s (derived) | 0/0 | — |
| x-preview-f-free | opencode | opencode/x-preview-f-free | 31 | 2 | 256 | 12.1% | ~2035s (derived) | 1/1 | incomplete |
| muse-spark-1.2-contributor-free | opencode | opencode/muse-spark-1.2-contributor-free | 35 | 0 | 512 | 6.8% | ~270s (derived) | 1/1 | incomplete |
| nemotron-3.5-lightning-free | opencode | opencode/nemotron-3.5-lightning-free | 27 | 3 | 434 | 6.2% | ~776s (derived) | 1/1 | incomplete |
| nemotron-3-ultra-free | opencode | opencode/nemotron-3-ultra-free | 31 | 2 | 509 | 6.1% | ~499s (derived) | 1/1 | incomplete |
| codex-spark-golden | sekhmet | gpt-5.3-codex-spark | 0 | 544 | 512 | 0% | 13s | 0/32 | quota-stub quota-stub os-error-122 |