Evaluation model
September 18, 2026 · View on GitHub
Reference for how Jev answers map to outcomes. For the short version, see review and fixed classifications.
Bernoulli questions, not true/false ones
A condition asks Jev to estimate p(true) from visible evidence (Jev native
type noul, answered {chance: P}); the threshold is the decision boundary
on p. Name the visible fact that moves p in guidance ("count only ...")
rather than restating truth conditions.
Confidence vs probability
Classification confidence and policy severity stay separate. Thresholds gate
on probability (P) only; confidence is displayed (for example
P=0.86 confidence=0.73) but never gates, suppresses, or applies an outcome.
An important gate does not block unless its probability crosses the configured
gate threshold; a high-confidence advisory remains non-blocking.
Which threshold governs what
gateThreshold governs gate conditions, secrets, AND fix_now-mapped choice
labels; advisoryThreshold governs advisory conditions and advisory-mapped
labels (a fix_now label between the two reports an uncertain-gate note).
Below-cutoff fallthrough
A choice whose top label scores below its outcome's cutoff falls through to approve for that scope — no failure, no note, no fallback to the next label — while the classification line is still printed.