Nested Lists Report for Exhaust
April 20, 2026 · View on GitHub
These results are from Exhaust v0.3.15, April 20th, 2026.
Normalization
Exhaust produced 1 distinct counterexample across 1000 test runs:
| Prevalence | Counterexample |
|---|---|
| 100% | [[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]] |
See the first 50 failing inputs before shrinking.
Performance
| Metric | Min | Max | Median | Mean | 95% CI |
|---|---|---|---|---|---|
| Evaluations | 23.0 | 69.0 | 36.0 | 37.1 | 36.6–37.5 |
| Reduction time (ms) | 0.46 | 2.55 | 0.74 | 0.75 | 0.74–0.76 |
| Iterations to failure | 4.0 | 13.0 | 6.0 | 6.4 | 6.3–6.5 |
Reproduction
From the exhaust/src folder, run the following command:
swift run ExhaustRunner --challenge nestedLists --iterations 1000
The reduction time reflects running on an M4 Max running macOS 26.4. This is an unoptimised debug build, mirroring the experience of using Exhaust inside a swift test target rather than a best-case release benchmark.