βš™οΈ Workflow Audit Template

May 3, 2026 Β· View on GitHub

πŸ“Œ Template Instructions: Copy to analysis/daily/{date}/{article-type}-run{N}/intelligence/workflow-audit.md. The AI agent produces this at the end of the run as a structured self-audit of how the 10-step protocol was executed. See methodologies/per-artifact-methodologies.md Β§workflow-audit.

🎯 Purpose: Transparent record of workflow execution β€” which phases ran, which MCP tools were called, which rules of ai-driven-analysis-guide.md were satisfied, and where the run fell short. A downstream reviewer (and the next same-type run) can use this to understand the run's internal quality.


πŸ“‹ Document Metadata

articleType: [REQUIRED]
runId: [REQUIRED]
date: [REQUIRED: YYYY-MM-DD]
analysisPhase: workflow-audit
confidenceLevel: [REQUIRED: HIGH / MEDIUM / LOW]
rulesAudited: [REQUIRED: integer β€” 11 Core Principles, see Β§3 below]
complianceRate: [REQUIRED: 0–100]

Confidence Compliance


1️⃣ Workflow Execution Summary

%%{init: {"theme":"dark","themeVariables":{"primaryColor":"#1565C0","primaryTextColor":"#ffffff","primaryBorderColor":"#0A3F7F","lineColor":"#90CAF9","secondaryColor":"#2E7D32","secondaryTextColor":"#ffffff","tertiaryColor":"#FF9800","tertiaryTextColor":"#000000","mainBkg":"#1565C0","secondBkg":"#2E7D32","tertiaryBkg":"#FF9800","noteBkgColor":"#FFC107","noteTextColor":"#000000","errorBkgColor":"#D32F2F","fontFamily":"Inter, Helvetica, Arial, sans-serif"}}}%%
flowchart LR
    P0["Phase 0<br/>Health gate"] --> P1["Phase 1<br/>Data collection"]
    P1 --> P2["Phase 2<br/>Editorial context"]
    P2 --> P3["Phase 3<br/>Analysis"]
    P3 --> P4["Phase 4<br/>Significance gate"]
    P4 --> P5["Phase 5<br/>Validation"]
    P5 --> P6["Phase 6<br/>PR creation"]

    style P0 fill:#1565C0,color:#ffffff
    style P1 fill:#1565C0,color:#ffffff
    style P2 fill:#0288D1,color:#ffffff
    style P3 fill:#7B1FA2,color:#ffffff
    style P4 fill:#FF9800,color:#000000
    style P5 fill:#2E7D32,color:#ffffff
    style P6 fill:#2E7D32,color:#ffffff
PhaseStatusNotes
Phase 0 β€” Health gate[βœ… / ⚠️ / ❌][REQUIRED: what gate returned]
Phase 1 β€” Data collection[βœ… / ⚠️ / ❌][REQUIRED: feeds attempted, feeds succeeded]
Phase 2 β€” Editorial context[βœ… / ⚠️ / ❌][REQUIRED]
Phase 3 β€” Analysis[βœ… / ⚠️ / ❌][REQUIRED: artifacts produced]
Phase 4 β€” Significance gate[βœ… / ⚠️ / ❌][REQUIRED: composite score vs. threshold]
Phase 5 β€” Validation[βœ… / ⚠️ / ❌][REQUIRED: validator exit code]
Phase 6 β€” PR creation[βœ… / ⚠️ / ❌ / ⏳][REQUIRED]

2️⃣ MCP Tool Call Log

#ToolArgs (truncated)ResultRecordsLatency
1[REQUIRED][REQUIRED][βœ…/⚠️/❌][#][ms]
2[REQUIRED][REQUIRED][...][#][ms]
3[REQUIRED][REQUIRED][...][#][ms]

Total MCP calls: [REQUIRED] Β· Successful: [#] Β· Degraded: [#] Β· Failed: [#]


3️⃣ Core Principles Compliance (11-principle protocol)

See ai-driven-analysis-guide.md Β§Core Principles.

#PrincipleStatusEvidence in run
1Folder isolation[βœ…/❌][REQUIRED: run dir path]
2AI does analysis, scripts do HTML[βœ…/❌][REQUIRED]
3Methodologies before analysis[βœ…/❌][REQUIRED: METHODOLOGIES_READ log line]
4Multi-framework depth[βœ…/⚠️/❌][REQUIRED: frameworks applied]
5Always commit analysis[βœ…/❌][REQUIRED]
6Article type everywhere[βœ…/❌][REQUIRED]
7Two passes, full time budget[βœ…/⚠️/❌][REQUIRED: Pass 1 min + Pass 2 min]
8AI-authored headlines + descriptions[βœ…/❌/ N/A][REQUIRED]
9Complete data + historical baseline[βœ…/⚠️/❌][REQUIRED]
10Read-before-article + footer + ratio + floors[βœ…/⚠️/❌][REQUIRED: validator output]
11OSINT / INTOP tradecraft discipline (WEP bands, Admiralty grades, β‰₯10 SATs in methodology-reflection)[βœ…/⚠️/❌][REQUIRED: link to methodology-reflection.md Β§12 SATs applied + Admiralty-graded source list]

Compliance rate: [# principles βœ…] / 11 = [%]


4️⃣ Artifact Production

FolderPlannedProducedShort (< floor)Notes
intelligence/[#][#][#][REQUIRED]
classification/[#][#][#][REQUIRED]
risk-scoring/[#][#][#][REQUIRED]
threat-assessment/[#][#][#][REQUIRED]
documents/[#][#][#][REQUIRED]

5️⃣ Time Budget

StepTargetActualDelta
Step 2 β€” Read methodologies4–6 min[REQUIRED][Β± min]
Step 3 β€” Collect EP data5–10 min[REQUIRED][Β± min]
Steps 4–7 β€” Analysis Pass 1β‰₯12 min[REQUIRED][Β± min]
Step 9 β€” Pass 2β‰₯8 min[REQUIRED][Β± min]
Step 10 β€” Validate + commit2–5 min[REQUIRED][Β± min]
Total run timeβ‰₯20 min active[REQUIRED][Β± min]

6️⃣ Issues & Deviations

For every deviation from the standard protocol:

Issue 1 β€” [REQUIRED: short name]

  • Symptom: [REQUIRED]
  • Root cause: [REQUIRED]
  • Workaround in this run: [REQUIRED]
  • Next-run recommendation: [REQUIRED]

(repeat per issue; no issues β†’ state "No deviations from protocol observed.")


7️⃣ Recommendations for the Next Same-Type Run

  1. [REQUIRED: concrete, actionable β€” e.g. "raise historical-baseline depth to β‰₯200 lines by fetching 3 additional prior-run comparables"]
  2. [REQUIRED]
  3. [REQUIRED]

8️⃣ EP MCP Tool Inputs (auditor's evidence basis)

EP MCP toolUsed for which audit principleNotes
get_voting_recordsP3 Evidence β€” RCV citations in artifactsAuditor cross-checks every RCV ID claimed.
analyze_coalition_dynamicsP4 Coalition arithmetic veracityTwo-window verification.
get_adopted_textsP3 Evidence β€” text-citation veracityConfirms quoted recitals exist.
get_committee_documentsP5 Source diversityβ‰₯1 committee-doc per major artifact.
track_legislation / get_proceduresP6 Legislative-pipeline accuracyProcedure-status drift between artifacts.
get_speechesP3 Evidence β€” quote attributionConfirms speakers + verbatim.
get_meeting_decisionsP7 Procedural veracityBureau / CoP rulings cited correctly.
correlate_intelligenceP11 Cross-tool correlationConfirms intelligence alerts feed into artifacts.

(Auditor uses these tools directly β€” does not rely on prior-stage agent outputs.)


9️⃣ Worked Pass-1 β†’ Pass-2 Example (60-min breaking-news run audit)

❌ Pass-1 (thin, 17 words):

"Run completed in 58 minutes. All artifacts present. Quality acceptable. No major issues observed during execution."

βœ… Pass-2 (compliant, 95 words):

Run 184 (breaking, 2026-04-18) executed in 58:42 (target 60:00). Stage budget actuals: Data 11:30 / Analysis 21:50 / Gate 3:20 / Article 17:40 / PR 4:22. Two principle deviations: P3 Evidence β€” voting-patterns.md cited RCV 2026/0089(COD) but no get_voting_records tool call recorded in tool-call log (LOW confidence flag missing β€” Partial); P9 Reflection β€” methodology-reflection.md documented only 8 of required 10 SATs (Partial). All other 9 principles Pass. Stage-C gate caught both deviations and triggered Pass-2 rewrites of the affected artifacts. Net verdict: CONDITIONAL PASS β€” recommendations Β§7 cover both deviations.


πŸ”Ÿ 11-Core-Principles Compliance Scorecard

#PrincipleCompliance levelWorked observation
P1BLUF disciplineβœ… PassAll intelligence-tier artifacts open with ≀2-sentence BLUF.
P2WEP / Admiralty tradecraftβœ… PassAll forward judgements carry WEP band + horizon.
P3Evidence sourcing (cite-or-don't-claim)⚠️ Partial1 RCV cited without get_voting_records tool-call evidence.
P4Coalition arithmetic disciplineβœ… PassSeat shares + cohesion deltas all from analyze_coalition_dynamics.
P5Source diversityβœ… Pass9 distinct EP MCP tools used across 25 artifacts.
P6Legislative-pipeline accuracyβœ… PassProcedure-status verified against track_legislation.
P7Procedural veracityβœ… PassRule numbers cited match published Rules of Procedure.
P8Read-Before-Write (article cites artifacts)βœ… PassAll article Β§Β§ cite per-section artifacts per 04-article-generation.md Β§7.1.
P9Methodology reflection (β‰₯10 SATs)⚠️ Partial8 of 10 SATs documented.
P10Per-artifact depth floorsβœ… PassAll artifacts meet reference-quality-thresholds.json.
P11Time-budget discipline (β‰₯45 min active work on 60-min budget)βœ… Pass47 min active per timestamps.

Composite: 9 Pass / 2 Partial / 0 Fail = CONDITIONAL PASS, requires Pass-2 fixes on P3 and P9 before PR.


1️⃣1️⃣ Worked 60-Minute Breaking-News Time-Budget Breakdown

PhaseTargetActual (Run 184)DeltaNotes
Stage A β€” Data collection (MCP feeds)12:0011:30-0:30Within tolerance.
Stage B Pass 1 β€” Analysis artifacts (initial draft)14:0013:20-0:40OK.
Stage B Pass 2 β€” Analysis rewrite + depth09:0008:30-0:30Below 9 min β€” auditor flag: rushed.
Stage C β€” Completeness gate03:0003:20+0:20Includes the two Partial-principle re-runs.
Stage D Pass 1 β€” Article draft11:0010:50-0:10OK.
Stage D Pass 2 β€” Article rewrite07:0006:50-0:10OK.
PR creation + final checks04:0004:22+0:22OK.
Total60:0058:42-1:18Active work 47:00 (β‰₯45-min floor).

1️⃣2️⃣ Anti-patterns β€” REJECT on Pass-2 Review

#Banned patternWhy it fails
1"All principles Pass" with no per-principle worked observationAudit must show its working; reviewer cannot verify.
2Time-budget table with target column only (no actual)Drift cannot be measured.
3"No deviations from protocol" claim while >1 artifact below depth floorInternally inconsistent.
4Recommendation "tighten Pass-2 review" without specifying artifact + principleNon-actionable.
5Audit assigning Pass to P9 with <10 SATs documentedHard contract; SAT count is checked.
6Citing tool-calls from get_voting_records while the EP roll-call publication delay >4 weeks (claim impossible)Auditor must verify upstream feed availability.

1️⃣3️⃣ Cross-References β€” Controlling Methodology


1️⃣4️⃣ Stage-C Completeness Signals

scripts/validate-analysis-completeness.js checks for this artifact:

CheckThresholdSource
Line floorβ‰₯100 lines (default)reference-quality-thresholds.json
Required H2 substrings"Compliance", "Time-Budget", "Recommendations"structural contract
Mermaid blockoptional (Gantt of stage timings if drift >5 %)visual contract
Tradecraft markersPer-principle Pass/Partial/Fail explicit; SAT count documentedai-driven-analysis-guide.md
Source diversityβ‰₯5 EP MCP tools cross-checkedper-artifact rule
Time-budget arithmeticTargets sum to 60/120 min; actuals + deltas explicittemplate logic

Document Control: /analysis/daily/{date}/{type}-run{N}/intelligence/workflow-audit.md Β· Template v1.2 Β· Depth floor: 100 lines.