Suite leaderboard (cross-toy)

September 22, 2026 · View on GitHub

Module: conceptmod/toys/suite_leaderboard.py

This board answers: which adv config(s) PASS every applicable CPU toy?

It is not leaderboard_honesty (that module is the single-toy two-pole cloud + claim_pass gate). Do not confuse the two.

Candidates (rows)

configmeaning
locked_sharedDemo LOCKED stamp (locked_adv_defaults / LOCKED): RpGAN logistic, b_cap coeff=1 κ=1, FM off, cover 1.5, n=12, particle_l2=0.02
music_cover_1_0Cover 1.0 + music posture, with the required drift report
stranger_pairStranger pairing drift
fm_onfm_weight=0.1
thinned_kappaThinned / κ-hardcoded b_cap
vanilla_logisticgan_mode=vanilla
hub128n_particles=128

Toy columns and applicability

kindmeaning
stampLocked-shared / demo stamp toys. A stamp sweep winner must PASS every applicable stamp cell (N/A excluded).
dslPhrase expand / phrase jobs / game-geometry. Scored once under locked_shared, or N/A for cover drifts. No second phrase recipe per config.

Cover posture is not a column on this board. Demo cover 1.5 and Music cover 1.0 are named claims in conceptmod/toys/cover_posture_fork.py. That toy still PASSes demo claim + demo pin, and music claim + music pin, and still FAILs a silent swap or the wrong pin. Scoring every suite candidate under both claims would report config identity (locked_shared is not the music config) as a formulation FAIL. Run that gate on its own:

python -m conceptmod.toys.cover_posture_fork

PASS all stamp toys ≠ Music / Anima / Supra GPU transfer. A suite PASS is CPU formulation only.

N/A appears when a family does not fork that knob (for example LoRA path targets, late-collapse selection rules, or DSL cover drifts). FAIL means the family's locked arm / refuse path / named drift arm rejects the config.

Run

python -m conceptmod.toys.suite_leaderboard
python -m conceptmod.toys.suite_leaderboard --stamp-only --quiet

pytest tests/test_toy_suite_leaderboard.py -q

Expected stamp sweep winner: locked_shared (demo). music_cover_1_0 still FAILs stamp toys that claim the demo floor. It does not appear as a suite FAIL for the demo claim, and locked_shared does not appear as a suite FAIL for the music claim.

Honesty: claiming a stamp sweep with an empty negative list raises HonestyError.