Awesome JEV [](https://awesome.re)

September 20, 2026 Β· View on GitHub

Awesome JEV: System One models and typed decisions in AI. State goes in, Jev returns parallel, typed, calibrated decisions such as route, approve, review, search and escalate, which software then acts on

Awesome JEV Awesome

Papers, open models and evaluations behind System One models and Jev.

Website

Entries Papers Open source Jev evals With code Daily Papers License

⚑ System One & Jev Β· πŸ§ͺ Open Source Β· πŸ“Š Evaluations Β· πŸ“° Commentary Β· 🧬 Lineage


Contents


πŸ”₯ News

πŸš€ 2026-09 Β· Repository launch. 119 entries in 8 sections. PRs welcome.

πŸ§ͺ 2026-09 Β· Open source and evaluations. 28 open models and codebases rebuild the System One shape, and 17 independent evaluations of Jev are collected under Independent Evaluations.


⚑ System One & Jev

What TypeSafe has published, kept to the load-bearing pages: the launch post, the contract, the failure modes it admits to, and the code it ships.

  • Introducing System One Models and Jev, The launch post: state in, typed probabilistic decisions out, RLCD training, 70 to 500 ms, $0.042 per MTok. TypeSafe
  • Primitives: Choice, Score, Noul, The three typed question shapes and the probability-per-option answers they return. TypeSafe
  • Jev 1.13 jaggedness, TypeSafe's documented failure modes: literal reading, counting, dates, indirection, distractor state, adversarial content. TypeSafe
  • System One Adapter, Official drop-in that serves the same typed interface from OpenAI or Anthropic models, the baseline for every comparison. Code
  • Hacker News launch thread, 1,850 points and 485 comments; the CEO confirms the zero-shot classifier reading and the encoder-with-heads shape. Hacker News
  • TypeSafe Agent Skills, Skill files that teach Claude Code, Codex and similar agents to design System One workflows. Code Website
  • Jev on Vercel AI SDK, The first third-party surface: Jev-latest as an evaluation model behind experimental_evaluate, no waitlist. Vercel
  • Founder launch thread on X, Diogo Almeida's thread arguing RLCD decision models reach economic value before chat models do. X

πŸ§ͺ Open Source

Open weights and code that rebuild the System One shape from encoders, small decoders and constrained decoding.

  • SemIf, Semantic ifs from open models on a 3090 at home; open baseline for direct typed option scoring, renamed from openjev. Code Website
  • Jevlike, From-scratch model with Jev's exact shape: text plus N options in, one probability per option out, option-attention head, Doom and chess demos. Code
  • PlayJev, Qwen3.5-0.8B-Base fine-tuned to play ten browser games from raw pixels, one frame in, one typed move out. Code Model Website
  • Qwen-2.5-1B-RLCD, Qwen2.5-1.5B fine-tune plus parallel constrained decoding; all schema fields scored in one broadcast prefill, 5.6x to 7x faster on Apple Silicon. Model
  • NanoJev, 0.6B parallel decision model with a public dataset and a side-by-side maze and Snake demo against Jev and untuned Qwen. Code
  • Bespoke Nimble, Data, model and recipe for an open Jev: Qwen3.5-9B plus LoRA on contrastive examples, with a 13-subset public evaluation suite scored against Jev 1.13. Code
  • kev, LoRA adapter and a small readout head on Qwen (0.5B to 8B) that answers many typed questions from one prefill, following the Jev architecture write-up. Code
  • LocalJev, Local Jev-compatible POST /v1/systemone in TypeScript for Bun, backed by DiffusionGemma through an OpenAI-compatible endpoint. Code
  • Laya-MLX, Native MLX runtime for Laya typed decisions on Apple Silicon, 13.4 ms median for a short decision, with a live Snake demo. Code
  • Simple Jev, Turns any open Hugging Face model into a classifier and scoring endpoint by reading next-token logits per question, with a public demo API. Code Website
  • openjev-sglang, Jev-compatible API endpoint served from open models with prefill-only inference. Code
  • decider, Qwen3.5-2B fine-tune that emits typed decisions with calibrated probabilities in one pass. Code
  • open-jev (Dasein Labs), One-pass option scoring with a local Gemma 3 4B on Apple silicon: prefill the context once, expand the KV cache across the options, softmax the option log-probs; Doom demo. Code
  • typesafe-ai-benchmark (imposter Jev), LLM gateway that mimics the TypeSafe structured-output contract, used for Qwen-on-Cerebras side-by-sides. Code
  • rlcd-modernbert-151m, Encoder-side reproduction: GLiClass ModernBERT base retrained for calibrated label probabilities. Code Model
  • LLM2Jev, Adapts local language models into Jev-compatible decision endpoints. Code
  • LitJev, Jev's decision layer on off-the-shelf Qwen checkpoints: one shared prefill, then option logits read per question, no training. Code
  • Jev on a laptop, Unofficial study of Jev-style parallel typed decisions on stock 1.5B to 8B models on Apple Silicon, with benchmarks. Code Space
  • open-jev (JoshuaSP), Typed JSON inference with DiffusionGemma: fixed JSON, parallel decisions. Code
  • openjev (zhihz), Local bilingual probability decisions from context, questions and candidate answers. Code
  • jevbetter, One-pass scorer over a variable option list: hashed n-gram encoder, rival-aware attention, gated head, temperature scaling. Code
  • qwen-rlcd, Choice, Score and Noul on Qwen3.5-0.8B, the smallest decoder-based reproduction. Code
  • Laya, ModernBERT-large with RLCD-trained decision heads: Choice, Score and Noul in one 38 ms pass. Model Space
  • Parallel Constrained Decision Engine, Live demo of the Qwen-2.5-1B-RLCD approach: KV-cache broadcast, logit slicing per candidate, 100 percent schema validity. Space
  • LFM2.5-350M-RLCD, 350M-parameter RLCD-style decision model, the smallest open attempt. Model
  • LFM2.5-2.6B-RLCD, RLCD-style fine-tune of Liquid AI's LFM2.5-2.6B, the largest open attempt so far. Model
  • system-one-qwen3.5-4b-scorer, Qwen3.5-4B base trained as a Score-style rubric rater. Model
  • system-one-mini, DistilBERT-sized System One shape, a floor for how small the idea can go. Model

πŸ”§ Built with Jev

Open, licensed software that puts Jev inside something that runs: routers, agents, games and integrations. Each entry links code you can read and numbers its authors measured themselves.

  • QuantDinger, Open-source AI trading OS with Jev System One decisions inside its agent and vibe trading loops. Code Website
  • Jev Ultrafast, Browser agent whose every step is one Jev choice over an indexed element table, a small LLM types only when the action is TYPE_TEXT; ZΓΌrich to London on Google Flights in 7.1 seconds. Code Website
  • fast-jev-compaction, Claude Code plugin that replaces the compaction summary with Jev decisions: every tool call and result scored in one request, stale ones dropped, everything kept verbatim. Code
  • jev-trader, One Jev decision every Monad block: buy or sell on the Kuru MON-USDC order book every 300 ms, each answer posted as a real limit order. Code
  • Distill, Lightweight coding-agent harness and TUI that routes its small decisions through Jev. Code
  • TipTour, Menu-bar companion for macOS where Jev picks the next click from locally detected controls and TipTour executes and validates it. Code
  • typesafe-computer-use, Drives a Mac from a plain-English goal at about a fiftieth of a cent per step: OCR the screen, Jev classifies the next action, a writing model only for free text. Code
  • jev-review, Staged code-review workflow with a local dashboard, each stage a Jev decision. Code
  • Jev Search, Plain-language web search where Jev picks sources, time ranges and terms, then ranks the results streamed from Search1API. Code Website
  • Mobile Jev, Standalone Android agent: one goal, a real phone, Jev makes every decision; opens Uber and books a route to the Golden Gate Bridge in the demo. Code
  • pg-jev, PostgreSQL extension that filters, ranks and classifies rows with plain-language conditions, every row judged by Jev; no index, no embeddings. Code Website
  • Jev Browser Use, Codex skill where Jev handles navigation, clicks, toggles and scrolling and Codex keeps text input and the final check; 5 to 10x faster browser operations in the authors' workflows. Code
  • quackd, One CLI for open-source robots such as LeRobot arms and Open Duck, with Jev choosing which taught move comes next. Code
  • Abide, Enforces the rules in AGENTS.md and CLAUDE.md that no linter can check: one Jev question per rule on every edit, about 300 ms each. Code
  • JevRouter, Routes models, subagents, Skills and MCP tools through one typed Jev question, with its own permission and confirmation rules around the answer; 44 percent first-five tool-call hits on 10 Toolathlon tasks against 24 percent for DeepSeek V4.1 Flash. Code Website
  • jev-drone, Quadrotor flies a five-station MuJoCo obstacle course from its onboard camera, Jev at 2.5 Hz deciding what the situation means while the controller stays in code. Code
  • YouTube sponsor detection, Detects sponsor segments from live audio and skips them, one Jev read per segment. Code
  • jevmeter, Puts a live Jev score meter on any video, installed in three steps. Code
  • Supercov, Code quality and coverage for coding agents: Jev scores the source, the usual test command runs, uncovered paths become small queries. Code Website
  • dspy-typesafeify, Decorator that routes DSPy typed Signatures to Jev where the signature is a pure decision. Code
  • Embodied Jev, MuJoCo robot decision workbench where Jev picks the next manipulation step. Code
  • Grok Bot + Jev, Connects TypeSafe Jev to Grok Bot as a cheap decision layer. Code
  • RefGarden, Spatial reference explorer over The Met, NASA and Cosmos, with Jev choosing search phrases and highlighting references from titles alone. Code
  • SmartMoney-Cub, Read-only trading journal and review harness with Jev judging entries against the evidence. Code
  • typesafe-mcp, MCP adapter that exposes Jev decisions as tools. Code
  • Jev Γ— LIBERO, Fine-grained robot control on LIBERO with Jev deciding and physics-grounded execution. Code
  • jev-robot-control, Same task, different decisions: Jev against GPT-4.1 and GPT-4o mini on a robot arm, with cost and time per episode. Code
  • tsai-sc, TypeSafe Jev controls the original StarCraft, one typed decision per game tick. Code

πŸ“Š Independent Evaluations

Every independent test of Jev published so far, with the headline number where the source gives one. TypeSafe's own dashboard is listed and marked official.

  • jev-benchmarks (probability-aware), Jev versus GLiNER2.5 on 300 BTZSC examples with calibration and selective risk: 0.910 AG News, 0.870 Banking77, worse on emotion. Code
  • jev-rerank-bench, Jev as reranker over 8 datasets and 1,617 questions: nDCG@10 0.692 versus Cohere Rerank 4 Pro 0.691, at 422ms. Code Website
  • jev-sec-bench, Blind prompt-injection run on 662 deepset messages: 96.5% accuracy, 0.9927 ROC-AUC, ECE 0.0588, p50 325ms. Code
  • TypeSafe Jev evals dashboard, TypeSafe's own four-workflow dashboard, Jev at 61.7 to 76.0% accuracy and 0.3 to 0.5s per case against frontier baselines. TypeSafe Website
  • jev-eval-agent, Jev routes 100 mocked tools behind a confidence gate, measuring steps, tool calls, tokens and cost against the LLM choosing directly. Code
  • jev-use benchmarks, 454 judgments against a Claude Opus 5 reference: 82.2% agreement, 89.5% among non-escalated verdicts, over a 68.7% majority baseline; context compaction 56.3%, below a constant answerer. Code
  • LegalForecastBench, Claim-level Brier scoring of federal motion-to-dismiss outcomes, a fixed binary with one probability per unit; no Jev row published yet. Code
  • jev-research-eval, Reproducible harness scoring Jev ultrafast research-browser runs over 11 baseline cases plus 18 human and quant stress cases with QC grades. Code
  • jev-benchmark (chess and NPC addressee), Jev no better than random picking chess moves from a FEN, but F1 0.96 on NPC addressee detection, 0.2s median. Code
  • padflow-jev-evals, Three production SaaS decisions published as schemas with auto-post confidence thresholds; LLM baseline rows filled, Jev row still empty. Code
  • jev-spam-eval, Zero-shot spam Noul on 18,514 emails reaching 0.9833 accuracy, matching a TF-IDF classifier trained on 14,800 labels. Code
  • jev-secret-detection, 100 balanced secret-detection cases as single Noul questions scored by accuracy, AUC and Brier; server p50 75 to 90ms. Code
  • jev-playground, Tic-tac-toe and connect four pitting Jev against four frontier models on identical legal-move choice options; no aggregate results published yet. Code
  • jev-benchmarks (frontier comparison harness), Harness asking Jev and frontier LLMs identical typed questions, scoring accuracy, calibration, latency and schema validity; no measured run published yet. Code
  • Near Here event validation, 50-case event validation: Jev 96% at 0.59s and $0.043 per 1,000, Mistral small 4 84%, Gemini Flash-Lite 86%. Website
  • Every: Mini-Vibe Check, 777 judgments over 37 articles in 0.7s for a quarter of a cent; caught six of seven planted defects, Fable seven. Website
  • Jev is the fish at the poker table, Poker probe finding 15 to 30 point swings from relabelling the same hand, and 16 of 16 bets against a made flush. Website
  • Jev judge call vs dimension scores, One direct Jev question per row against 12 to 14 Jev-scored dimensions with fitted weights on three tasks: 0.9076 vs 0.8373 on Japanese NLI, but 25x the hard-benign false positives, 37.2% vs 1.5%. Website

πŸ“° Commentary & Analysis

Reporting and technical commentary that checks the launch claims against the evidence.


🧬 The Shape Before Jev

Earlier work with the same input and output shape: a fixed answer set, one probability per option, no generated text. Label-conditioned encoders, scalar reward heads, reinforcement learning for calibrated confidence, and the single-pass inference TypeSafe's own forks point at.

  • Zero-shot Classification as Entailment, "Benchmarking Zero-shot Text Classification: Datasets, Evaluation and Entailment Approach". Label set given at inference, an entailment model returns one probability per label, no text generated. EMNLP 2019 arXiv Code Daily Papers
  • InstructGPT reward model, "Training language models to follow instructions with human feedback". A Bradley-Terry head emits one scalar per response in a single pass, no text, co-authored by Jev's founder. arXiv Code Daily Papers
  • ProtectAI prompt-injection DeBERTa v2, 184M DeBERTa returning a binary injection probability, the BERT-style encoder guardrail HN engineers mapped Jev onto. Code Model
  • RLCR, "Beyond Binary Rewards: Training LMs to Reason About Their Uncertainty". Adds a Brier-score reward to RLVR so the model emits calibrated confidence, the closest published relative of TypeSafe's RLCD. ICLR 2026 arXiv Code Daily Papers Website
  • LLaDA, "Large Language Diffusion Models". The typesafe-ai GitHub org forked this masked diffusion LM, the strongest public hint at how Jev fills every answer slot in one pass. arXiv Code Daily Papers Model Website
  • GLiNER, "Generalist Model for Named Entity Recognition using Bidirectional Transformer". The span-and-label encoder family HN mapped Jev onto, types supplied at inference and scored in one bidirectional pass. arXiv Code Daily Papers Model
  • GLiClass, "Generalist Lightweight Model for Sequence Classification Tasks". The open analogue HN pointed at: labels and text in one encoder pass, one probability per label, no decoding. arXiv Code Daily Papers Model
  • monoBERT, "Passage Re-ranking with BERT". Landmark cross-encoder: pair in, one scalar relevance probability out, no generation, the ancestor of Jev's Score primitive. arXiv Code Daily Papers
  • Generative or Discriminative?, "Revisiting Text Classification in the Era of Transformers". Controlled comparison of encoder, autoregressive and diffusion classifiers over fixed label sets on accuracy, calibration and ordinality. EMNLP 2025 arXiv
  • Llama Guard, "LLM-based Input-Output Safeguard for Human-AI Conversations". Fixed safety taxonomy with the verdict read off one safe/unsafe token probability, the guardrail classifier Noul replaces. arXiv Code Daily Papers
  • GPT-4 Technical Report. Reports that RLHF destroys the base model's calibration, the finding RLCD is positioned against. arXiv Daily Papers
  • Rewarding Doubt, "A Reinforcement Learning Approach to Calibrated Confidence Expression of Large Language Models". Trains confidence expression by RL on the logarithmic scoring rule, an independent rediscovery of the proper-scoring-rule reward RLCD uses. ICLR 2026 arXiv Code
  • Calibration-Aware RL for Decision-Making LLMs, "Balancing Classification and Calibration Performance in Decision-Making LLMs via Calibration Aware Reinforcement Learning". RL that adjusts decision-token probabilities directly, keeping RLVR accuracy while cutting ECE, the closest public analogue of Jev's typed decision heads. arXiv
  • vLLM, "Efficient Memory Management for Large Language Model Serving with PagedAttention". The typesafe-ai GitHub org forked this engine; paged KV cache plus prefix caching is what makes extra questions over one shared state nearly free. SOSP 2023 arXiv Code Daily Papers Website
  • Mercury, "Ultra-Fast Language Models Based on Diffusion". HN read Jev as a stripped down text diffusion model, and Mercury is that idea shipped commercially with parallel refinement. arXiv Daily Papers Website

🧱 What Jev Is Sold Against

The tools TypeSafe and the launch discussion named as what Jev replaces: constrained decoding, structured outputs, typed prompt programming, LLM judges, routers and guard classifiers.

  • Outlines, "Efficient Guided Generation for Large Language Models". The finite-state-machine guided decoding HN named as the incumbent way to get typed values, which Jev claims to replace. arXiv Code Daily Papers Website
  • DSPy, "Compiling Declarative Language Model Calls into Self-Improving Pipelines". Typed signatures compiled into prompts, named on the HN thread as the fair comparison for Jev's typed question interface. ICLR 2024 arXiv Code Daily Papers Website
  • RouteLLM, "Learning to Route LLMs with Preference Data". Router scores a fixed two model set and returns win probability per option before any text is generated. arXiv Code Daily Papers
  • Guidance, Constrained generation library named on the HN launch thread as what Jev's typed outputs get compared against. Code
  • OpenAI Structured Outputs, The provider-side JSON-schema guarantee the CEO named on HN as what Jev replaces, shape enforced but no probability returned. Website
  • Let Me Speak Freely?, "A Study on the Impact of Format Restrictions on Performance of Large Language Models". Measures the accuracy format restrictions cost, the study behind the CEO's HN claim that constrained decoding makes models dumber. EMNLP 2024 Industry Track arXiv Code Daily Papers
  • JSONSchemaBench, "A Rigorous Benchmark of Structured Outputs for Language Models". 10k real schemas scored on validity, coverage and latency, the constrained-decoding route Jev's 0% type errors claim competes against. arXiv Code Daily Papers Dataset
  • MT-Bench, "Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena". The landmark LLM-as-a-judge paper, named on the launch thread as the layer Jev's score and Noul primitives replace. NeurIPS 2023 arXiv Code Daily Papers
  • Constitutional Classifiers, "Defending against Universal Jailbreaks across Thousands of Hours of Red Teaming". Input and output classifiers gating a frontier model on a fixed policy, the deployed slot Noul targets. arXiv Daily Papers Website

🧠 Where the Name Comes From

System 1 in Kahneman's sense, the bitter lesson TypeSafe argues with, and the Jevons paradox the model is named after.


The two sibling lists.


Contributing

Open a pull request. Link the paper or the primary page, add the code repository or Hugging Face path if there is one, and say in one line which of the three tests above the entry passes. See CONTRIBUTING.md for the entry format.


Footnotes

@misc{awesome_jev,
  title        = {Awesome JEV},
  year         = {2026},
  howpublished = {\url{https://github.com/OmniJev/awesome-jev-gallery}},
  note         = {Papers, open models and evaluations behind System One models and typed decisions}
}