Awesome Open System One [](https://awesome.re)
September 20, 2026 ยท View on GitHub
A curated list of the open System One ecosystem: open models, training methods, independent benchmarks, and the calibration and constrained-decoding tooling that make typed, confidence-aware decisions work.
"System One models" (a term from TypeSafe's Jev launch, after Kahneman's System 1) make fast, typed, calibrated decisions that software consumes directly, classify, route, score, gate, instead of generating text you parse and hope about. Jev itself is closed, hosted, and waitlisted. This list tracks the open side: reproductions you can run, independent evaluations you can check, and the underlying techniques (calibrated confidence, constrained decoding, conformal abstention) that predate the name and outlive any one product.
Every link is verified. Entries are open source or openly readable. For lists of projects using the closed Jev, see the other awesome-jev lists; this one is deliberately about what you can run and audit yourself.
Contents
- What Is a System One Model
- Open Models and Reproductions
- Independent Benchmarks and Evaluations
- Calibration and Selective Prediction
- Constrained and Structured Decoding
- Reference and Reading
What Is a System One Model
A System One model takes a block of state plus a set of typed questions and returns, in one parallel pass, a typed answer per question with a calibrated confidence, rather than a token-by-token text string. The output is schema-valid by construction (it must be one of the options you declared), and the confidence is meant to be trustworthy enough to branch on. The category is new as a name; the ingredients, zero-shot classification, calibrated probabilities, constrained decoding, conformal abstention, are established and open, which is what this list collects.
Open Models and Reproductions
Open models and runnable replicas of the System One idea.
- poorjev - Local-first System One layer on commodity models with provably calibrated confidence (measured ECE 0.170 to 0.071), typed primitives, no API key.
- von - Open-source System One decision model: sub-15ms, non-autoregressive, local drop-in alternative to Jev.
- Laya - A 421M non-autoregressive System One decision engine with RLCD-trained calibrated probabilities and multilingual support.
- NanoJev - A minimal nanoGPT-style replica of Jev: parallel decisions, dynamic candidates, and an end-to-end training pipeline.
- nanojev (single-file) - A single-file, MIT-licensed educational implementation with a small serving UI and HTTP API.
Independent Benchmarks and Evaluations
Third-party evaluations of typed decision models, measuring what the marketing pages assert.
- jev-benchmarks - Probability-aware evaluation for typed decision models: calibration, selective risk, latency, and reproducible benchmarks.
- jev-baselines-eval - Pre-registered independent eval of Jev against a nano-class LLM, a frontier LLM, and a supervised encoder on Banking77 and CLINC150.
- jev-eval - Independent eval of Jev vs a frontier LLM across labelled classification tasks: accuracy, calibration, latency, and cost.
Calibration and Selective Prediction
The techniques that make a confidence score trustworthy, and let a model abstain instead of guessing.
- conformal-prediction - Angelopoulos and Bates: lecture notes and runnable notebooks on conformal prediction and distribution-free uncertainty, the basis for principled abstention.
- MAPIE - Scikit-learn-compatible library for prediction intervals and sets with guaranteed coverage, usable for the "escalate when unsure" path.
Constrained and Structured Decoding
Making output schema-valid by construction rather than by parsing, an adjacent lineage that System One models formalize.
- Outlines - Structured generation that constrains a model to a grammar, regex, or JSON schema, so invalid output is impossible.
- XGrammar - Fast, flexible structured-generation engine for constraining LLM outputs to a grammar with low overhead.
- Instructor - Structured outputs from LLMs via typed schemas, with validation and retries; a common baseline for typed decisions today.
- Guidance - Constrained generation with interleaved control, so structure is enforced during decoding rather than after.
- LM Format Enforcer - Enforces JSON schema or regex on LLM output during generation.
Reference and Reading
- Introducing System One Models and Jev - TypeSafe's launch post that named the category and stated the thesis.
- System One (TypeSafe docs) - The concept and interface as defined by the model's authors.
- Building a Harness with Jev - LangChain's practical walkthrough of wiring a decision model into an agent harness.
- On Calibration of Modern Neural Networks - Guo et al., 2017. Introduces temperature scaling and ECE, the calibration foundations these models rely on.
Contributing
Contributions welcome. Please read CONTRIBUTING.md. In short: the entry must be open source or openly readable, on-topic (open System One models, their evaluation, or the calibration and constrained-decoding techniques behind them), described in one factual line, and the link must work.