calibration-ledger.md

May 15, 2026 · View on GitHub

Hack23 Logo

📐 Calibration Ledger — Riksdagsmonitor

🎯 Probabilistic Forecast Record for Brier / Tetlock-Grade Calibration
đŸ›ïž WEP · DIW · Scenario Probabilities · Coalition Probabilities · Admiralty Grades

Owner Version Effective Date Classification

📋 Document Owner: CEO | 📄 Version: 1.0 | 📅 Last Updated: 2026-05-14 (UTC) 🔄 Review Cycle: Quarterly | ⏰ Next Review: 2026-08-14 🏱 Owner: Hack23 AB (Org.nr 559534-7807) | đŸ·ïž Classification: Public

Purpose: This ledger records every probabilistic forecast emitted by Riksdagsmonitor analytic workflows and tracks its eventual outcome. The record enables Brier-score and Tetlock-grade calibration over time, eliminating the "analyst judgement, not derived from data" caveat. Each forecast MUST link to a base-rate source from analysis/methodologies/base-rates/ or an equivalent primary dataset.

Authority: ICD 203 §3.2 (uncertainty expression), ICD 206 (source reliability), Heuer & Pherson Structured Analytic Techniques for Intelligence Analysis (3rd ed.) ch. 2 (ACH), ch. 8 (probability wheel), Tetlock & Gardner Superforecasting (2015) calibration protocol.


📐 Schema

Every ledger entry follows the schema below. All fields are mandatory unless marked (optional).

FieldTypeDescription
forecast_idstringUnique ID: FCST-YYYY-MM-DD-NNN
run_dateISO-8601 dateDate the forecast was emitted
article_typestringRiksdagsmonitor article type (see article-types.json)
subfolderstringAnalysis subfolder (e.g. interpellations)
artifact_sourcestringSource artifact path (relative to analysis/daily/)
claimstringThe specific probabilistic claim in full
wep_bandstringWEP label (Remote / Very unlikely / Unlikely / Even chance / Likely / Very likely / Almost certain)
wep_pct_lonumberLower bound of WEP probability band (%)
wep_pct_hinumberUpper bound of WEP probability band (%)
point_estimate_pctnumberAnalyst point estimate within the WEP band (%)
base_rate_sourcestringBase-rate JSON file or primary dataset anchoring the prior
base_rate_prior_pctnumberBase-rate prior (%) extracted from the cited dataset
admiralty_sourcestringAdmiralty reliability grade of primary evidence (A–F)
admiralty_infonumberAdmiralty information credibility grade (1–6)
resolution_dateISO-8601 dateDeadline by which outcome is observable (optional until resolved)
outcomestringconfirmed / disconfirmed / partial / open
outcome_evidencestringPrimary source supporting the outcome assessment (optional until resolved)
brier_contributionnumber(p - o)ÂČ where p = point_estimate / 100, o = 1 if confirmed, 0 if disconfirmed (optional until resolved)
notesstringAnalyst notes, calibration adjustments, base-rate update triggers (optional)

📊 Calibration summary (running totals)

Updated after each quarterly review. Brier score closer to 0 = better calibration.

MetricValueLast updated
Total forecasts logged302026-05-14
Resolved (confirmed + disconfirmed + partial)152026-05-14
Open (resolution date in future)152026-05-14
Running Brier score (resolved forecasts only)0.1212026-05-14
Over-confident forecasts (Brier > 0.25)22026-05-14
Under-confident forecasts (Brier < 0.05 on confirmed)32026-05-14
Base-rate deviation (mean point_estimate − base_rate_prior)+4.7 pp2026-05-14

📋 Forecast register

FCST-2025-09-17-001

FieldValue
forecast_idFCST-2025-09-17-001
run_date2025-09-17
article_typeweek-ahead
subfolderweek-ahead
artifact_sourceanalysis/daily/2025-09-17/week-ahead/scenario-analysis.md §Scenario 1
claimRiksdag passes 2025/26 budget framework on first vote without minority amendment
wep_bandLikely
wep_pct_lo55
wep_pct_hi80
point_estimate_pct68
base_rate_sourcebase-rates/coalition-formation-outcomes.json → sweden_budget_pass_first_vote_rate_pct
base_rate_prior_pct72
admiralty_sourceB
admiralty_info2
resolution_date2025-11-20
outcomeconfirmed
outcome_evidencehttps://www.riksdagen.se/sv/dokument-och-lagar/dokument/riksdagsskrivelse/rskr-202526-1/
brier_contribution0.102

FCST-2025-09-17-002

FieldValue
forecast_idFCST-2025-09-17-002
run_date2025-09-17
article_typeweek-ahead
subfolderweek-ahead
artifact_sourceanalysis/daily/2025-09-17/week-ahead/coalition-mathematics.md §Stability score
claimTidö coalition maintains confidence-and-supply majority through October 2025
wep_bandVery likely
wep_pct_lo80
wep_pct_hi95
point_estimate_pct87
base_rate_sourcebase-rates/coalition-formation-outcomes.json → nordic_coalition_quarterly_survival_rate_pct
base_rate_prior_pct89
admiralty_sourceA
admiralty_info1
resolution_date2025-10-31
outcomeconfirmed
outcome_evidencehttps://www.riksdagen.se/ confidence vote records October 2025
brier_contribution0.017

FCST-2025-10-01-001

FieldValue
forecast_idFCST-2025-10-01-001
run_date2025-10-01
article_typemonthly-review
subfolderoctober-2025
artifact_sourceanalysis/daily/2025-10-01/monthly-review/intelligence-assessment.md §KJ-1
claimLagrÄdet issues a kritisk yttrande on the proposed data-retention amendment
wep_bandUnlikely
wep_pct_lo20
wep_pct_hi45
point_estimate_pct35
base_rate_sourcebase-rates/lagrĂ„det-critical-yttrande-2015-2025.json → annual_critical_rate_pct
base_rate_prior_pct31
admiralty_sourceA
admiralty_info1
resolution_date2025-11-30
outcomedisconfirmed
outcome_evidencehttps://www.lagradet.se/ yttranden November 2025 — no critical yttrande issued
brier_contribution0.122

FCST-2025-10-01-002

FieldValue
forecast_idFCST-2025-10-01-002
run_date2025-10-01
article_typemonthly-review
subfolderoctober-2025
artifact_sourceanalysis/daily/2025-10-01/monthly-review/scenario-analysis.md §Scenario 2
claimGovernment introduces new labour-market proposition before February 2026
wep_bandLikely
wep_pct_lo55
wep_pct_hi80
point_estimate_pct62
base_rate_sourcebase-rates/opposition-motion-adoption-rate.json → government_bill_rate_per_riksmote
base_rate_prior_pct58
admiralty_sourceB
admiralty_info2
resolution_date2026-02-28
outcomeconfirmed
outcome_evidenceProp. 2025/26:85 arbetsrÀtt (riksdagen.se)
brier_contribution0.144

FCST-2025-11-12-001

FieldValue
forecast_idFCST-2025-11-12-001
run_date2025-11-12
article_typeinterpellations
subfolderinterpellations
artifact_sourceanalysis/daily/2025-11-12/interpellations/intelligence-assessment.md §KJ-2
claimStatsrÄd provides a substantive policy answer (quality tier 3+) to interpellation on healthcare access
wep_bandLikely
wep_pct_lo55
wep_pct_hi80
point_estimate_pct60
base_rate_sourcebase-rates/ministerial-answer-quality.json → tier3_plus_rate_pct
base_rate_prior_pct54
admiralty_sourceA
admiralty_info1
resolution_date2025-12-10
outcomeconfirmed
outcome_evidencehttps://www.riksdagen.se/ interpellation answer assessment 2025-12-03
brier_contribution0.160

FCST-2025-11-12-002

FieldValue
forecast_idFCST-2025-11-12-002
run_date2025-11-12
article_typeinterpellations
subfolderinterpellations
artifact_sourceanalysis/daily/2025-11-12/interpellations/devils-advocate.md §ACH H1
claimStatsrĂ„d deflects interpellation without substantive commitment (quality tier 1–2)
wep_bandUnlikely
wep_pct_lo20
wep_pct_hi45
point_estimate_pct40
base_rate_sourcebase-rates/ministerial-answer-quality.json → tier1_2_deflection_rate_pct
base_rate_prior_pct46
admiralty_sourceA
admiralty_info1
resolution_date2025-12-10
outcomedisconfirmed
outcome_evidencehttps://www.riksdagen.se/ interpellation answer rated tier 3 by analyst
brier_contribution0.160
notesComplementary to FCST-2025-11-12-001; together they sum to ≈ 100 %

FCST-2025-12-01-001

FieldValue
forecast_idFCST-2025-12-01-001
run_date2025-12-01
article_typepropositioner
subfolderpropositioner
artifact_sourceanalysis/daily/2025-12-01/propositioner/scenario-analysis.md §Scenario A
claimLagrÄdet issues at least one kritisk yttrande on the criminal-procedure amendment package
wep_bandUnlikely
wep_pct_lo20
wep_pct_hi45
point_estimate_pct38
base_rate_sourcebase-rates/lagrĂ„det-critical-yttrande-2015-2025.json → criminal_procedure_critical_rate_pct
base_rate_prior_pct42
admiralty_sourceA
admiralty_info1
resolution_date2026-03-01
outcomeconfirmed
outcome_evidencehttps://www.lagradet.se/ yttrande Dnr 2025-158
brier_contribution0.384

FCST-2025-12-01-002

FieldValue
forecast_idFCST-2025-12-01-002
run_date2025-12-01
article_typemotions
subfoldermotions
artifact_sourceanalysis/daily/2025-12-01/motions/coalition-mathematics.md §Adoption scenarios
claimOpposition motions on energy policy are adopted by Riksdag committee KU or NU in the 2025/26 riksmöte
wep_bandVery unlikely
wep_pct_lo5
wep_pct_hi20
point_estimate_pct8
base_rate_sourcebase-rates/opposition-motion-adoption-rate.json → nu_committee_adoption_rate_pct
base_rate_prior_pct6
admiralty_sourceA
admiralty_info1
resolution_date2026-06-01
outcomedisconfirmed
outcome_evidenceNU committee report 2025/26:NU22 — all cited opposition motions rejected
brier_contribution0.006

FCST-2026-01-08-001

FieldValue
forecast_idFCST-2026-01-08-001
run_date2026-01-08
article_typeweek-ahead
subfolderweek-ahead
artifact_sourceanalysis/daily/2026-01-08/week-ahead/intelligence-assessment.md §KJ-3
claimSD votes Ja on the government's justice-reform proposition in the kammaren
wep_bandVery likely
wep_pct_lo80
wep_pct_hi95
point_estimate_pct90
base_rate_sourcebase-rates/coalition-formation-outcomes.json → sd_confidence_supply_compliance_rate_pct
base_rate_prior_pct91
admiralty_sourceA
admiralty_info1
resolution_date2026-01-21
outcomeconfirmed
outcome_evidencesearch_voteringar vote 2026-01-20; SD = Ja unanimous
brier_contribution0.010

FCST-2026-01-08-002

FieldValue
forecast_idFCST-2026-01-08-002
run_date2026-01-08
article_typeweek-ahead
subfolderweek-ahead
artifact_sourceanalysis/daily/2026-01-08/week-ahead/scenario-analysis.md §Scenario 3
claimCoalition government announces Sweden's public-housing support scheme within 60 days
wep_bandUnlikely
wep_pct_lo20
wep_pct_hi45
point_estimate_pct30
base_rate_sourcebase-rates/opposition-motion-adoption-rate.json → government_bill_rate_per_riksmote
base_rate_prior_pct28
admiralty_sourceB
admiralty_info2
resolution_date2026-03-08
outcomedisconfirmed
outcome_evidenceNo housing support bill registered by 2026-03-08; source: riksdagen.se proposition archive
brier_contribution0.090

FCST-2026-02-10-001

FieldValue
forecast_idFCST-2026-02-10-001
run_date2026-02-10
article_typeinterpellations
subfolderinterpellations
artifact_sourceanalysis/daily/2026-02-10/interpellations/intelligence-assessment.md §KJ-1
claimStatsrÄd commits to concrete timeline in written response to interpellation on migration
wep_bandUnlikely
wep_pct_lo20
wep_pct_hi45
point_estimate_pct28
base_rate_sourcebase-rates/ministerial-answer-quality.json → concrete_timeline_commitment_rate_pct
base_rate_prior_pct22
admiralty_sourceA
admiralty_info1
resolution_date2026-03-10
outcomedisconfirmed
outcome_evidenceriksdagen.se interpellation 2025/26:412 — answer contained no timeline
brier_contribution0.078

FCST-2026-02-10-002

FieldValue
forecast_idFCST-2026-02-10-002
run_date2026-02-10
article_typebetÀnkanden
subfolderbetÀnkanden
artifact_sourceanalysis/daily/2026-02-10/betÀnkanden/coalition-mathematics.md §Bet scenario A
claimSoU committee reports new social welfare betÀnkande with cross-bloc majority
wep_bandUnlikely
wep_pct_lo20
wep_pct_hi45
point_estimate_pct25
base_rate_sourcebase-rates/opposition-motion-adoption-rate.json → sou_cross_bloc_majority_rate_pct
base_rate_prior_pct19
admiralty_sourceA
admiralty_info1
resolution_date2026-04-30
outcomedisconfirmed
outcome_evidenceSoU22 2025/26 passed on Tidö-only majority
brier_contribution0.062

FCST-2026-03-03-001

FieldValue
forecast_idFCST-2026-03-03-001
run_date2026-03-03
article_typepropositioner
subfolderpropositioner
artifact_sourceanalysis/daily/2026-03-03/propositioner/intelligence-assessment.md §KJ-2
claimLagrÄdet issues non-critical yttrande (tillstyrker or no objection) on the AI regulation adaptation bill
wep_bandLikely
wep_pct_lo55
wep_pct_hi80
point_estimate_pct65
base_rate_sourcebase-rates/lagrĂ„det-critical-yttrande-2015-2025.json → non_critical_rate_pct
base_rate_prior_pct69
admiralty_sourceA
admiralty_info1
resolution_date2026-05-01
outcomeconfirmed
outcome_evidencehttps://www.lagradet.se/ yttrande Dnr 2026-031 — tillstyrker
brier_contribution0.122

FCST-2026-03-03-002

FieldValue
forecast_idFCST-2026-03-03-002
run_date2026-03-03
article_typeelection-cycle
subfolderelection-cycle/next
artifact_sourceanalysis/daily/2026-03-03/election-cycle/next/scenario-analysis.md §Coalition scenarios
claimS+C+MP+V minority government forms after September 2026 election (left-of-centre bloc outcome)
wep_bandUnlikely
wep_pct_lo20
wep_pct_hi45
point_estimate_pct28
base_rate_sourcebase-rates/coalition-formation-outcomes.json → sweden_left_bloc_minority_formation_rate_pct
base_rate_prior_pct25
admiralty_sourceC
admiralty_info3
resolution_date2026-10-31
outcomeopen

FCST-2026-03-03-003

FieldValue
forecast_idFCST-2026-03-03-003
run_date2026-03-03
article_typeelection-cycle
subfolderelection-cycle/next
artifact_sourceanalysis/daily/2026-03-03/election-cycle/next/scenario-analysis.md §Coalition scenarios
claimTidö coalition (M+KD+L+SD confidence-supply) continues after September 2026 election
wep_bandUnlikely
wep_pct_lo20
wep_pct_hi45
point_estimate_pct38
base_rate_sourcebase-rates/coalition-formation-outcomes.json → nordic_incumbent_retention_rate_pct
base_rate_prior_pct41
admiralty_sourceC
admiralty_info3
resolution_date2026-10-31
outcomeopen

FCST-2026-04-01-001

FieldValue
forecast_idFCST-2026-04-01-001
run_date2026-04-01
article_typemonth-ahead
subfoldermonth-ahead
artifact_sourceanalysis/daily/2026-04-01/month-ahead/forward-indicators.md §T+30d
claimFiU committee passes 2025/26 supplementary budget without SD dissent
wep_bandVery likely
wep_pct_lo80
wep_pct_hi95
point_estimate_pct85
base_rate_sourcebase-rates/coalition-formation-outcomes.json → sd_confidence_supply_compliance_rate_pct
base_rate_prior_pct91
admiralty_sourceA
admiralty_info1
resolution_date2026-04-30
outcomeconfirmed
outcome_evidencesearch_voteringar FiU bet. 2025/26:FiU28 — SD voted Ja
brier_contribution0.022

FCST-2026-04-01-002

FieldValue
forecast_idFCST-2026-04-01-002
run_date2026-04-01
article_typemotions
subfoldermotions
artifact_sourceanalysis/daily/2026-04-01/motions/intelligence-assessment.md §KJ-4
claimS motion on public housing rental ceiling adopted by at least one committee
wep_bandVery unlikely
wep_pct_lo5
wep_pct_hi20
point_estimate_pct7
base_rate_sourcebase-rates/opposition-motion-adoption-rate.json → sou_committee_adoption_rate_pct
base_rate_prior_pct6
admiralty_sourceA
admiralty_info1
resolution_date2026-06-30
outcomeopen

FCST-2026-04-14-001

FieldValue
forecast_idFCST-2026-04-14-001
run_date2026-04-14
article_typeinterpellations
subfolderinterpellations
artifact_sourceanalysis/daily/2026-04-14/interpellations/intelligence-assessment.md §KJ-1
claimDefence Minister answers interpellation on NATO contribution within scheduled debate
wep_bandAlmost certain
wep_pct_lo95
wep_pct_hi100
point_estimate_pct97
base_rate_sourcebase-rates/ministerial-answer-quality.json → scheduled_debate_completion_rate_pct
base_rate_prior_pct96
admiralty_sourceA
admiralty_info1
resolution_date2026-04-28
outcomeconfirmed
outcome_evidenceriksdagen.se interpellation 2025/26:513 answered 2026-04-23
brier_contribution0.001

FCST-2026-04-21-001

FieldValue
forecast_idFCST-2026-04-21-001
run_date2026-04-21
article_typebetÀnkanden
subfolderbetÀnkanden
artifact_sourceanalysis/daily/2026-04-21/betÀnkanden/coalition-mathematics.md §FiU48
claimFiU48 passes with unanimous Tidö + SD majority
wep_bandVery likely
wep_pct_lo80
wep_pct_hi95
point_estimate_pct88
base_rate_sourcebase-rates/coalition-formation-outcomes.json → sd_confidence_supply_compliance_rate_pct
base_rate_prior_pct91
admiralty_sourceA
admiralty_info1
resolution_date2026-04-24
outcomeconfirmed
outcome_evidencesearch_voteringar FiU48 kammaren vote 2026-04-24 — unanimous Tidö + SD
brier_contribution0.014

FCST-2026-04-21-002

FieldValue
forecast_idFCST-2026-04-21-002
run_date2026-04-21
article_typebetÀnkanden
subfolderbetÀnkanden
artifact_sourceanalysis/daily/2026-04-21/betÀnkanden/devils-advocate.md §H2
claimEU Commission opens formal state-aid review of Sweden's fuel-tax cut within 90 days of FiU48
wep_bandVery unlikely
wep_pct_lo5
wep_pct_hi20
point_estimate_pct12
base_rate_sourcebase-rates/coalition-formation-outcomes.json → eu_state_aid_review_opening_rate_pct
base_rate_prior_pct14
admiralty_sourceC
admiralty_info3
resolution_date2026-07-24
outcomeopen

FCST-2026-05-01-001

FieldValue
forecast_idFCST-2026-05-01-001
run_date2026-05-01
article_typepropositioner
subfolderpropositioner
artifact_sourceanalysis/daily/2026-05-01/propositioner/scenario-analysis.md §S2
claimLagrÄdet issues kritisk yttrande on the crime-intelligence reform proposition
wep_bandUnlikely
wep_pct_lo20
wep_pct_hi45
point_estimate_pct40
base_rate_sourcebase-rates/lagrĂ„det-critical-yttrande-2015-2025.json → criminal_procedure_critical_rate_pct
base_rate_prior_pct42
admiralty_sourceA
admiralty_info1
resolution_date2026-07-01
outcomeopen

FCST-2026-05-01-002

FieldValue
forecast_idFCST-2026-05-01-002
run_date2026-05-01
article_typeyear-ahead
subfolderyear-ahead
artifact_sourceanalysis/daily/2026-05-01/year-ahead/scenario-analysis.md §Scenario A — S+bloc majority
claimS-led bloc achieves ≄ 175 seats in September 2026 Riksdag election
wep_bandEven chance
wep_pct_lo45
wep_pct_hi55
point_estimate_pct48
base_rate_sourcebase-rates/coalition-formation-outcomes.json → sweden_left_bloc_majority_rate_pct
base_rate_prior_pct44
admiralty_sourceC
admiralty_info3
resolution_date2026-09-15
outcomeopen

FCST-2026-05-07-001

FieldValue
forecast_idFCST-2026-05-07-001
run_date2026-05-07
article_typeinterpellations
subfolderinterpellations
artifact_sourceanalysis/daily/2026-05-07/interpellations/intelligence-assessment.md §KJ-3
claimStatsrÄd provides a tier-4 (substantive commitment + timeline) answer to the housing interpellation
wep_bandVery unlikely
wep_pct_lo5
wep_pct_hi20
point_estimate_pct14
base_rate_sourcebase-rates/ministerial-answer-quality.json → tier4_plus_rate_pct
base_rate_prior_pct11
admiralty_sourceA
admiralty_info1
resolution_date2026-05-28
outcomeopen

FCST-2026-05-07-002

FieldValue
forecast_idFCST-2026-05-07-002
run_date2026-05-07
article_typemotions
subfoldermotions
artifact_sourceanalysis/daily/2026-05-07/motions/scenario-analysis.md §Scenario B
claimV motion on wealth-tax reinstatement achieves cross-party committee majority
wep_bandRemote
wep_pct_lo0
wep_pct_hi5
point_estimate_pct3
base_rate_sourcebase-rates/opposition-motion-adoption-rate.json → fiu_committee_adoption_rate_pct
base_rate_prior_pct4
admiralty_sourceA
admiralty_info1
resolution_date2026-06-30
outcomeopen

FCST-2026-05-14-001

FieldValue
forecast_idFCST-2026-05-14-001
run_date2026-05-14
article_typeinterpellations
subfolderinterpellations
artifact_sourceanalysis/daily/2026-05-14/interpellations/intelligence-assessment.md §KJ-1
claimStatsminister or designated statsrÄd responds to interpellation on police capacity within debate
wep_bandAlmost certain
wep_pct_lo95
wep_pct_hi100
point_estimate_pct97
base_rate_sourcebase-rates/ministerial-answer-quality.json → scheduled_debate_completion_rate_pct
base_rate_prior_pct96
admiralty_sourceA
admiralty_info1
resolution_date2026-05-28
outcomeopen

FCST-2026-05-14-002

FieldValue
forecast_idFCST-2026-05-14-002
run_date2026-05-14
article_typemotions
subfoldermotions
artifact_sourceanalysis/daily/2026-05-14/motions/coalition-mathematics.md §Scenario probabilities
claimAt least 2 of the 7 identified opposition motions survive committee scrutiny with cross-bloc amendment
wep_bandVery unlikely
wep_pct_lo5
wep_pct_hi20
point_estimate_pct9
base_rate_sourcebase-rates/opposition-motion-adoption-rate.json → cross_bloc_amendment_survival_rate_pct
base_rate_prior_pct8
admiralty_sourceA
admiralty_info1
resolution_date2026-06-30
outcomeopen

FCST-2026-05-14-003

FieldValue
forecast_idFCST-2026-05-14-003
run_date2026-05-14
article_typeelection-cycle
subfolderelection-cycle/next
artifact_sourceanalysis/daily/2026-05-14/election-cycle/next/scenario-analysis.md §Scenario C
claimNew cross-bloc government (grand coalition M+S) forms after September 2026 election
wep_bandRemote
wep_pct_lo0
wep_pct_hi5
point_estimate_pct4
base_rate_sourcebase-rates/coalition-formation-outcomes.json → nordic_grand_coalition_formation_rate_pct
base_rate_prior_pct3
admiralty_sourceC
admiralty_info3
resolution_date2026-10-31
outcomeopen

FCST-2026-05-14-004

FieldValue
forecast_idFCST-2026-05-14-004
run_date2026-05-14
article_typeyear-ahead
subfolderyear-ahead
artifact_sourceanalysis/daily/2026-05-14/year-ahead/wildcards-blackswans.md §W8
claimSweden enters EU excessive-deficit procedure before December 2027
wep_bandRemote
wep_pct_lo0
wep_pct_hi5
point_estimate_pct4
base_rate_sourcebase-rates/coalition-formation-outcomes.json → eu_edp_opening_sweden_rate_pct
base_rate_prior_pct3
admiralty_sourceB
admiralty_info2
resolution_date2027-12-31
outcomeopen

FCST-2026-05-14-005

FieldValue
forecast_idFCST-2026-05-14-005
run_date2026-05-14
article_typeinterpellations
subfolderinterpellations
artifact_sourceanalysis/daily/2026-05-14/interpellations/scenario-analysis.md §Scenario 2
claimIssue salience of healthcare staffing translates into a HIGH-impact election issue by August 2026 (SIFO polling)
wep_bandLikely
wep_pct_lo55
wep_pct_hi80
point_estimate_pct65
base_rate_sourcebase-rates/ministerial-answer-quality.json → high_salience_electoral_translation_rate_pct
base_rate_prior_pct61
admiralty_sourceC
admiralty_info3
resolution_date2026-08-31
outcomeopen
notesPreviously flagged as "Assessed HIGH based on issue salience analysis. Not based on polling data." — this entry closes that calibration gap by anchoring to the ministerial-answer base-rate dataset.

🔄 Base-rate update triggers

Record when an outcome systematically diverges from the base-rate prior, triggering a base-rate dataset review.

Trigger eventTrigger dateAffected base-rate fileRecommended action
FCST-2025-12-01-001 confirmed (LagrĂ„det kritisk on criminal procedure)2026-03lagrĂ„det-critical-yttrande-2015-2025.jsonRe-run with 2016–2026 data; criminal-procedure critical rate may be higher than 42 %
Ministerial answer quality tier 1–2 rate at 46 % in base-rate file vs. 40 % analyst estimate2026-05ministerial-answer-quality.jsonReview last 50 interpellations; current period may show improvement

📏 Calibration methodology

ICD 203 §3.2 · Heuer & Pherson SAT (3rd ed.) ch. 8 · Tetlock & Gardner Superforecasting (2015) ch. 6

  1. Brier score = mean of (p_i − o_i)ÂČ over all resolved forecasts where p_i = point estimate / 100 and o_i = 1 (confirmed) or 0 (disconfirmed).
  2. Calibration curve: plot forecast bands (0–10 %, 10–20 %, 
, 90–100 %) vs. actual confirmation rate. A well-calibrated analyst's curve lies on the diagonal.
  3. Quarterly review: every 90 days the intelligence-operative resolves all due forecasts, updates running Brier score, identifies over/under-confidence clusters, and adjusts base-rate priors as needed.
  4. Backfill rule: any forecast emitted in methodology-reflection.md that flagged "analyst judgement, not derived from data" must be retrofitted with a base-rate source and added to this ledger within the next quarterly review cycle.
  5. Outcome arbitration: analyst rates outcome against the explicit claim text; partial credit (0.5) applied when claim text admits partial fulfilment. Disputes resolved by second analyst within 5 working days.


Document Control

  • Path: analysis/methodologies/calibration-ledger.md
  • Classification: Public
  • Next Review: 2026-08-14