Capability-to-evidence manifest

August 5, 2026 ยท View on GitHub

This manifest maps every advertised FastPLMs 1.0 capability to its user documentation, runnable example, and required validation tier. It is a coverage contract, not a statement that an unreported run passed. The exact checkpoint list and family declarations come from src/fastplms/models.toml.

The Example column links a curated CLI when that interface exposes the whole capability. Programmatic-only forms instead link their runnable CPU contract so the manifest does not imply broader CLI coverage than the example provides.

Frozen ESMC release evidence

Status: pending. Default documentation generation never discovers or trusts reports implicitly. Release rendering requires an explicitly selected, complete schema-v3 set of exactly 30 records on one exact GH200/aarch64 target: 18 measured eager, SDPA, and Flex records plus 12 structured FlashAttention 2/3 unavailable records across three checkpoints and two immutable sequence panels. The set must also carry the final candidate/reference image identities, dependency lock, installed inventory, and official source attestations. A partial, stale, malformed, self-digest-invalid, or cross-device set fails closed and cannot replace this status.

Locked oracle package compatibility exception

The frozen oracle lock permits exactly one nonzero pip check diagnostic: nvidia-cusparselt-cu13 0.8.1 is not supported on this platform. It applies only to nvidia-cusparselt-cu13==0.8.1 on NVIDIA GH200 480GB / linux / aarch64. The vendor filename tag is py3-none-manylinux2014_aarch64, while the wheel metadata declares py3-none-manylinux2014_sbsa. The exact wheel is nvidia_cusparselt_cu13-0.8.1-py3-none-manylinux2014_aarch64.whl with SHA-256 4dca476c50bf4780d46cd0bfbd82e2bc10a08e4fef7950917ce8d7578d22a23f. FastPLMs accepts this vendor metadata mismatch only after the lock, installed inventory, wheel bytes, metadata tag, and target identity all match. The wheel is not rewritten (validated-vendor-metadata-exception-no-wheel-rewrite). Any additional diagnostic or identity drift fails closed.

Executable evidence selectors

Only the selectors below are claimed. Their scopes are intentionally narrower than a whole family or validation tier. A tier appearing on another row does not automatically apply to the capability in this row.

SelectorTier/jobExecutable targetScope
cpu:autoclass-runtimecpu_contracttests/cpu/test_autoclass_evidence_matrix.py::test_autoclass_runtime_evidence_matrix_exactly_matches_all_45_entries
tests/cpu/test_autoclass_evidence_matrix.py::test_autoclass_runtime_evidence_targets_are_collected_cpu_tests
Every family-level AutoClass entry and its explicit tiny runtime contracts.
artifact:checkpoint-autoclassesartifacttests/release/test_published_automodel.py::test_local_artifact_offline_autoclass_parityEvery advertised AutoClass for every built checkpoint, grouped by checkpoint.
compliance:sequence-primary-headcompliancetests/parity/test_native_results.py::test_native_exact_checkpoint_contract
tests/parity/test_native_results.py::test_native_every_checkpoint_bf16_inference
The official-parity head only: AutoModel for ANKH or a family without MaskedLM; otherwise AutoModelForMaskedLM.
compliance:ankh-seq2seqcompliancetests/parity/test_native_results.py::test_native_ankh_explicit_decoder_prompt_generationANKH AutoModelForSeq2SeqLM explicit-prompt generation only.
compliance:structure-automodelcompliancetests/structure/test_esmfold_folding_compliance.py
tests/structure/test_esmfold2_folding_compliance.py
ESMFold and ESMFold2 AutoModel folding paths only.
benchmark:claim-eligible-primary-headbenchmarkbenchmarks/suite.py::benchmark_cases[claim_eligible=True]The benchmark-selected head for representative sequence checkpoints and ESMFold2 projection cases; startup and embedding cases are excluded.
cpu:attention-contractscpu_contracttests/cpu/test_attention_contracts.pyPortable dispatch, masks, fallback, fake FA2/FA3, ESMC Flex/FA3, and eager/SDPA gradient contracts.
nightly:sequence-backendsnightlytests/integration/test_backend_consistency.pyCurrent GH200 eager, SDPA, and Flex forward/backward paths. Flash kernels are not downloaded, built, or executed in the current locked environment.
historical:fa2-focusedhistoricaltools/remote/run.py::_kernel_capability_preflightPolicy records prior real FlashAttention 2 focused execution, but the immutable execution report is not bundled in this repository and no current GH200 numerical claim is inferred from it.
compliance:flash-unavailable-gh200compliancetests/parity/test_native_results.py::test_esmc_bf16_calibration_and_biological_holdoutComplete report-bound FA2/FA3 unavailability records and fail-closed dispatch on the frozen release environment.
compliance:deep-backendscompliancetests/parity/test_native_results.py::test_native_representatives_all_backendsEvery advertised backend on the pinned deep sequence representative per family.
benchmark:claim-eligible-backendsbenchmarkbenchmarks/suite.py::benchmark_cases[claim_eligible=True]Backends emitted by claim-eligible sequence and ESMFold2 benchmark cases.
cpu:embedding-contractscpu_contracttests/cpu/test_embedding_contracts.pyOrdered inputs, biological masking, pooling, streaming, and persistence.
cpu:e1-embeddingscpu_contracttests/cpu/test_e1_contracts.pyE1 raw-sequence and MSA embedding persistence.
feature:e1-ragfeaturetests/integration/test_e1_rag.pyE1 retrieval, MSA preparation, cache, scoring, and embedding flows.
cpu:ankh-contractscpu_contracttests/cpu/test_ankh_contracts.pyANKH encoder and explicit-decoder embeddings, layers, masks, and T5 views.
cpu:generation-contractscpu_contracttests/cpu/test_generation_contracts.pyTiny deterministic DPLM, DPLM2, and ESM3 generation contracts.
feature:generationfeaturetests/integration/test_dplm_generation.py
tests/integration/test_esm3.py
DPLM, DPLM2, and ESM3 generation behavior in the feature suite.
cpu:peftcpu_contracttests/cpu/test_peft_contracts.pyReal initializer, collators, one optimizer step, and adapter/classifier reload.
nightly:peftnightlytests/unit/test_fine_tuning_example.pyFine-tuning example contracts in the nightly feature job.
cpu:tttcpu_contracttests/cpu/test_ttt_contracts.pySeeded TTT initialization, update, reset, save, reload, and family isolation.
feature:tttfeaturetests/integration/test_ttt.pyTTT integration behavior in the feature suite.
cpu:structure-contractscpu_contracttests/cpu/test_structure_contracts.pyTiny injected structure cores, public outputs, save/reload, and binder batching.
structure:public-contractsstructuretests/structure/test_structure_public_helpers.pySeeded Boltz helper, linker masking, real features, losses, and binder gradients.
structure:full-suitestructuretests/structureThe declared GPU structure suite for folding and preparation behavior.
feature:binderfeaturetests/integration/test_binder_design.pySeeded binder workflow, atom padding, critic ranking, and traceability.
cpu:artifact-examplecpu_contracttests/cpu/test_documentation_contracts.py::test_artifact_loading_example_executes_local_only_autoconfigThe offline local-artifact example with AutoConfig.
cpu:task-head-examplecpu_contracttests/cpu/test_documentation_contracts.py::test_task_head_example_executes_all_advertised_heads_offlineOffline ESM2 masked-LM scoring, contacts, sequence classification, and token classification through the documented example.

Curated offline example execution

Every curated example is routed to the exact collected CPU test nodes below. These tests run under the required offline cpu_contract gate.

ExampleTierExact executable CPU node
embedding_and_retrieval.pycpu_contracttests/cpu/test_documentation_contracts.py::test_embedding_and_retrieval_example_executes_with_ordered_sqlite
attention_switching.pycpu_contracttests/cpu/test_documentation_contracts.py::test_attention_switching_main_executes_optimized_and_masked_fallback
ankh_embeddings.pycpu_contracttests/cpu/test_documentation_contracts.py::test_ankh_embedding_example_executes_encoder_and_decoder_layers
generation.pycpu_contracttests/cpu/test_documentation_contracts.py::test_generation_example_executes_seeded_dplm_branch_offline
generation.pycpu_contracttests/cpu/test_documentation_contracts.py::test_generation_example_executes_seeded_dplm2_branch_offline
generation.pycpu_contracttests/cpu/test_documentation_contracts.py::test_generation_example_executes_seeded_esm3_trace
e1_rag.pycpu_contracttests/cpu/test_documentation_contracts.py::test_e1_rag_example_executes_local_msa_and_shared_persistence
ttt.pycpu_contracttests/cpu/test_documentation_contracts.py::test_ttt_example_executes_seeded_adapt_save_and_reset
structure_preparation.pycpu_contracttests/cpu/test_documentation_contracts.py::test_structure_preparation_example_executes_each_public_branch
artifact_loading.pycpu_contracttests/cpu/test_documentation_contracts.py::test_artifact_loading_example_executes_local_only_autoconfig
task_heads.pycpu_contracttests/cpu/test_documentation_contracts.py::test_task_head_example_executes_all_advertised_heads_offline
fine_tuning.pycpu_contracttests/cpu/test_peft_contracts.py::test_fine_tuning_main_wires_both_tasks_without_external_io
fine_tuning.pycpu_contracttests/cpu/test_peft_contracts.py::test_shipped_collators_create_tokenizer_aware_sequence_and_pair_batches
fine_tuning.pycpu_contracttests/cpu/test_peft_contracts.py::test_shipped_initializer_drives_one_peft_step_and_atomic_final_reload
binder_design_fastplms.pycpu_contracttests/cpu/test_structure_contracts.py::test_public_binder_workflow_pads_heterogeneous_prepared_atoms_without_truncation
binder_design_fastplms.pycpu_contracttests/cpu/test_structure_contracts.py::test_binder_example_main_wires_explicit_offline_cli_arguments
binder_design_fastplms.pycpu_contracttests/cpu/test_structure_contracts.py::test_binder_structure_loss_is_finite_and_differentiable

Families and AutoClasses

FamilyTokenizer modeAutoClassWeight statusGuideFamily workflow and runnable entry-point contractRequired evidence
esm2tokenizerAutoConfigFastPLMs extensionguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses
esm2tokenizerAutoModelpretrainedguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses
esm2tokenizerAutoModelForMaskedLMpretrainedguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses, cpu:task-head-example, compliance:sequence-primary-head, benchmark:claim-eligible-primary-head
esm2tokenizerAutoModelForSequenceClassificationbase weights + untrained task headguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses, cpu:task-head-example
esm2tokenizerAutoModelForTokenClassificationbase weights + untrained task headguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses, cpu:task-head-example
esm_plusplustokenizerAutoConfigFastPLMs extensionguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses
esm_plusplustokenizerAutoModelpretrainedguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses
esm_plusplustokenizerAutoModelForMaskedLMpretrainedguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses, compliance:sequence-primary-head, benchmark:claim-eligible-primary-head
esm_plusplustokenizerAutoModelForSequenceClassificationbase weights + untrained task headguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses
esm_plusplustokenizerAutoModelForTokenClassificationbase weights + untrained task headguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses
esm3tokenizerAutoConfigFastPLMs extensionguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses
esm3tokenizerAutoModelpretrainedguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses, compliance:sequence-primary-head, benchmark:claim-eligible-primary-head
esm3tokenizerAutoModelForSequenceClassificationbase weights + untrained task headguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses
esm3tokenizerAutoModelForTokenClassificationbase weights + untrained task headguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses
e1sequenceAutoConfigFastPLMs extensionguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses
e1sequenceAutoModelpretrainedguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses
e1sequenceAutoModelForMaskedLMpretrainedguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses, compliance:sequence-primary-head, benchmark:claim-eligible-primary-head
e1sequenceAutoModelForSequenceClassificationbase weights + untrained task headguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses
e1sequenceAutoModelForTokenClassificationbase weights + untrained task headguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses
dplmtokenizerAutoConfigFastPLMs extensionguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses
dplmtokenizerAutoModelpretrainedguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses
dplmtokenizerAutoModelForMaskedLMpretrainedguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses, compliance:sequence-primary-head, benchmark:claim-eligible-primary-head
dplmtokenizerAutoModelForSequenceClassificationbase weights + untrained task headguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses
dplmtokenizerAutoModelForTokenClassificationbase weights + untrained task headguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses
dplm2tokenizerAutoConfigFastPLMs extensionguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses
dplm2tokenizerAutoModelpretrainedguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses
dplm2tokenizerAutoModelForMaskedLMpretrainedguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses, compliance:sequence-primary-head, benchmark:claim-eligible-primary-head
dplm2tokenizerAutoModelForSequenceClassificationbase weights + untrained task headguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses
dplm2tokenizerAutoModelForTokenClassificationbase weights + untrained task headguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses
ankhtokenizerAutoConfigFastPLMs extensionguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses
ankhtokenizerAutoModelpretrainedguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses, compliance:sequence-primary-head, benchmark:claim-eligible-primary-head
ankhtokenizerAutoModelForMaskedLMFastPLMs extensionguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses
ankhtokenizerAutoModelForSeq2SeqLMpretrainedguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses, compliance:ankh-seq2seq
ankhtokenizerAutoModelForSequenceClassificationbase weights + untrained task headguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses
ankhtokenizerAutoModelForTokenClassificationbase weights + untrained task headguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses
boltz2structureAutoConfigFastPLMs extensionguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses
boltz2structureAutoModelpretrainedguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses
esmfoldstructureAutoConfigFastPLMs extensionguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses
esmfoldstructureAutoModelpretrainedguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses, compliance:structure-automodel
esmfoldstructureAutoModelForSequenceClassificationbase weights + untrained task headguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses
esmfoldstructureAutoModelForTokenClassificationbase weights + untrained task headguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses
esmfold2structureAutoConfigFastPLMs extensionguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses
esmfold2structureAutoModelpretrainedguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses, compliance:structure-automodel, benchmark:claim-eligible-primary-head
esmfold2structureAutoModelForSequenceClassificationbase weights + untrained task headguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses
esmfold2structureAutoModelForTokenClassificationbase weights + untrained task headguidefamily workflow; runnable AutoClass contractcpu:autoclass-runtime, artifact:checkpoint-autoclasses

Attention backends

BackendAdvertising familiesGuideExampleRequired evidence
eagerankh, boltz2, dplm, esm2, esm3, esm_plusplus, esmfold, esmfold2guideexamplecpu:attention-contracts, nightly:sequence-backends, compliance:deep-backends, benchmark:claim-eligible-backends
flash_attention_2esm2, esm_plusplusguideexamplecpu:attention-contracts, historical:fa2-focused, compliance:flash-unavailable-gh200
flash_attention_3dplm, esm2, esm_plusplusguideexamplecpu:attention-contracts, compliance:flash-unavailable-gh200
flex_attentiondplm, e1, esm2, esm3, esm_plusplus, esmfold, esmfold2guideexamplecpu:attention-contracts, nightly:sequence-backends, compliance:deep-backends, benchmark:claim-eligible-backends
sdpaankh, dplm, dplm2, e1, esm2, esm3, esm_plusplus, esmfold, esmfold2guideexamplecpu:attention-contracts, nightly:sequence-backends, compliance:deep-backends, benchmark:claim-eligible-backends

Input, embedding, and storage contracts

CapabilityGuideExampleRequired evidence
Sequence list or streaming FASTAembedding APIembedding and retrievalcpu:embedding-contracts
Ordered mapping or one-shot generatorembedding APIrunnable API contractscpu:embedding-contracts
Biological-residue max_length, bounded token windows, and stable orderembedding APIrunnable API contractscpu:embedding-contracts
Mean and standard-deviation poolingembedding APIembedding and retrievalcpu:embedding-contracts
Max/norm/median/variance/CLS/PARTI poolingembedding APIrunnable pooler contractcpu:embedding-contracts
Full-residue and all-selected-layer outputembedding APIANKH layerscpu:embedding-contracts, cpu:ankh-contracts
Transactional sharded safetensors and exact resumeembedding APIembedding and retrievalcpu:embedding-contracts
Read-only SQLite and ordered duplicate-preserving filtersembedding APIembedding and retrievalcpu:embedding-contracts
Legacy SQLite conversion without pickle deserializationembedding APIrunnable converter contractcpu:embedding-contracts
E1 raw-sequence and MSA-aware ordered embeddingsE1 guideE1 RAGcpu:e1-embeddings, feature:e1-rag
ANKH encoder/explicit-decoder hidden-state selectionANKH guideANKH layerscpu:ankh-contracts

Generation and adaptation contracts

CapabilityGuideExampleRequired evidence
ESM2 pretrained masked-LM scoring and contact predictionESM2task headscpu:task-head-example, cpu:autoclass-runtime
ESM2 sequence/token classification with explicitly untrained task headsESM2task headscpu:task-head-example, cpu:autoclass-runtime
DPLM amino-acid diffusion generationDPLMgenerationcpu:generation-contracts, feature:generation
DPLM2 modality-aware sequence/structure co-generationDPLM2generationcpu:generation-contracts, feature:generation
ESM3 multimodal-conditioned generationESM3generationcpu:generation-contracts, feature:generation
ANKH task-prompted sequence-to-sequence generationANKHANKH embeddings and generationcpu:ankh-contracts, compliance:ankh-seq2seq
Trainer/PEFT LoRA with immutable inputs and verified save/reloadfine-tuningfine-tuningcpu:peft, nightly:peft
Seeded TTT adapter initialize/update/reset/save/reloadTTTTTTcpu:ttt, feature:ttt

Structure contracts

CapabilityGuideExampleRequired evidence
ESMFold single-chain folding and multimer-linker confidence maskingmodelsstructure preparationcpu:structure-contracts, structure:public-contracts, structure:full-suite, compliance:structure-automodel
Seed-scoped Boltz2 protein helper and BF16 execution policyBoltz2structure preparationcpu:structure-contracts, structure:public-contracts, structure:full-suite
Atom-dense binder optimization and critic reportingbinder designbinder designcpu:structure-contracts, structure:public-contracts, feature:binder
Offline local artifact AutoClass loadingartifactsartifact loadingcpu:artifact-example, artifact:checkpoint-autoclasses
esmfold2 48-block full ESMFold2: single-sequence or optional MSA-conditioned protein inputs, typed complexes, ligands, nucleic acids, modifications, and bonds; pocket and distogram requests fail closedESMFold2structure preparationcpu:structure-contracts, structure:full-suite, compliance:structure-automodel
esmfold2_fast 24-block Fast ESMFold2: inference-optimized single-sequence conditioning with typed multichain and multimolecule inputs; every protein must have msa=None and MSA inputs fail closedESMFold2structure preparationcpu:structure-contracts, structure:full-suite, compliance:structure-automodel
esmfold2_experimental_cutoff2025 48-block full ESMFold2: single-sequence or optional MSA-conditioned protein inputs, typed complexes, ligands, nucleic acids, modifications, and bonds; pocket and distogram requests fail closedESMFold2structure preparationcpu:structure-contracts, structure:full-suite, compliance:structure-automodel
esmfold2_experimental_fast_cutoff2025 24-block Fast ESMFold2: inference-optimized single-sequence conditioning with typed multichain and multimolecule inputs; every protein must have msa=None and MSA inputs fail closedESMFold2structure preparationcpu:structure-contracts, structure:full-suite, compliance:structure-automodel

Release evidence must name the exact head, checkpoint and runtime revisions, tokenizer identity, backend, dtype, hardware, sequence or structure panel, seed, environment, and input hash. Missing evidence remains visibly pending; it must not be replaced by a synthetic benchmark number or an inferred claim.