Documentation Inspection - 2026-05-03

May 2, 2026 ยท View on GitHub

This is a Fagan-style documentation inspection of the repo's public documentation and organization. It combines five independent review passes with a local inventory of the Markdown corpus.

Scope

SurfaceCountInspection Treatment
All Markdown files2,736Inventoried and grouped by surface
docs/ Markdown files2,423Public/user/dev/reference surfaces inspected; imported research grouped
docs/research/ Markdown files2,182Grouped as research corpus, not user onboarding docs
docs/research/external/ Markdown files1,869Grouped as imported source material
docs/user/ Markdown files32Independently rated
docs/reference/ Markdown files36Representative generated references rated
docs/direction/ Markdown files23Grouped; active direction docs sampled
skills/ Markdown files155skills/README.md and representative SKILL.md docs rated; all skill docs inventoried
Shipped skill docs61 plus one templateCatalog-level inspection
Flow docs4 operator docs, 4 .flow manifests, one template, one READMEIndependently rated

The repo has enough imported and generated material that "every Markdown file is a user doc" is the wrong organizing model. The useful distinction is:

  • onboarding docs: explain what Content Machine is and how to start
  • agent operation docs: teach Codex CLI, Claude Code, or similar harnesses how to use the skill pack
  • skill and flow docs: define actual agent behavior
  • reference docs: generated from registries and not edited by hand
  • research/import docs: source material that should not compete with onboarding
  • archive/legacy docs: useful history but not the current product surface

Imported, generated, and historical files are grouped deliberately to avoid false precision. If any of those files becomes an active onboarding, install, skill, flow, or showcase doc, it should get an individual row in the scorecard.

Criteria

Scores are 1 to 5, where 5 is strongest. For Maintainability, 5 means low drift risk and easy ownership.

CriterionQuestion
P PurposeCan a reader tell why this doc exists within ten seconds?
Aud AudienceIs it clear whether the reader is a user, agent, contributor, or maintainer?
Acc AccuracyDo commands, counts, status labels, and source-of-truth claims match the repo?
Act ActionabilityDoes the doc give the next command, artifact, or decision point?
Scan Scan easeCan a low-attention reader find the relevant path fast?
MaintainabilityIs the doc unlikely to drift, duplicate, or become stale?

Dependent inspection scores use the same 1 to 5 scale and ask whether a reader can move across docs without contradiction.

Executive Verdict

The docs are not thin; they are over-complete. The main issue is not lack of documentation. The main issue is that several good entry points compete with each other, and some execution docs have drifted from the harness runtime.

Best current reader path:

  1. README.md for the short pitch and visual proof.
  2. docs/user/AGENT-HARNESS-INSTALL.md for installing into an agent project.
  3. docs/user/showcase/README.md for what the system can make.
  4. skills/README.md and flows/README.md for the agent-facing surface.
  5. scripts/harness/README.md only when implementing or debugging runtime calls.

Highest priority fixes:

  1. Fix flow docs/runtime drift, especially flows/doctor.flow.
  2. Reduce competing onboarding routes in README.md.
  3. Move verification earlier in the agent quickstart.
  4. Split skills/README.md into job-based discovery categories.
  5. Make showcase maturity/status come from one canonical source.

Independent Ratings - Root And Onboarding

DocPAudAccActScanMaintainabilityNotes
README.md434422Strong pitch, but too many "start here" sections compete.
docs/README.md444343Good docs map; should stay secondary to user quickstart.
docs/user/README.md554444Clearest ordered user index.
AGENTS.md554543Useful for agents; static entrypoint list can drift.
CLAUDE.md455354Minimal generated pointer; good low-risk Claude entry.
DIRECTION.md333242Directional value, but stale counts and historical wording.
CONTRIBUTING.md443453Clean contributor doc; quality and Node version wording drift.
CHANGELOG.md444343Useful release history, not an onboarding surface.
CODE_OF_CONDUCT.md555454Standard and clear.
SECURITY.md554454Clear disclosure path; verify contact/process before release.
SUPPORT.md554454Clear support routing.
VENDORING.md444443Useful governance doc; keep linked from source-media guidance.

Independent Ratings - Install And Agent Operation

DocPAudAccActScanMaintainabilityNotes
docs/user/AGENT-HARNESS-INSTALL.md554443Strong install doc; diagnostics should appear before generation.
docs/user/AGENT-QUICKSTART.md444332Useful but mixes install, repo checkout, generation, and reinstall loop.
docs/user/INSTALLATION.md543443Good setup doc; Whisper section describes a check as an install.
docs/user/CONFIGURATION.md444443Useful once installed; should keep pointing to generated env reference.
docs/user/providers/gemini.md444443Focused provider doc; should stay tied to provider config facts.
scripts/harness/README.md554454Good maintainer/runtime entry; not the first user doc.

Dependent score for install -> verify -> generate -> review: 3/5. Install is clear. Verification and review are present, but not consistently adjacent to the commands a first-time agent runs.

Independent Ratings - Showcase, Examples, And Review

DocPAudAccActScanMaintainabilityNotes
docs/user/showcase/README.md554453Strong visual menu; keep it as human gallery.
docs/demo/README.md554444Good generated demo index; dense by design.
docs/demo/provenance/README.md544454Strong audit trail.
docs/user/QUALITY-AND-REVIEW.md554553Good publish gate; conflicts with one golden label.
docs/user/ARCHETYPES.md554443Useful status matrix; should be source-backed.
docs/user/CREATIVE-SOURCES.md545452Valuable source catalog; external-source churn creates drift risk.
docs/user/EXAMPLES.md444443Good bridge; should prefer harness-first examples.
docs/user/examples/README.md545454Strong example index.
docs/user/examples/content-machine-self-demo.md555543Best repo-explainer recipe.
docs/user/examples/reddit-post-over-gameplay.md554452Flagship page; boxed caption follow-up now aligns status and OCR gate.
docs/user/examples/reddit-story-split-screen.md555454Strong lane doc.
docs/user/examples/procedural-gameplay-backgrounds.md555454Strong additive 3D/procedural example.
docs/user/examples/motion-card-lesson.md545543Runnable and clear.
docs/user/examples/split-screen-gameplay.md444543Actionable but overlaps story-gameplay docs.
docs/user/examples/latest-news-listicle.md433441Older command style; high drift.
docs/user/examples/nanobanana-veo.md444451Useful but provider/status churn risk.
docs/user/examples/nanobanana-kenburns.md444452Useful visual example; provider naming can drift.
docs/user/examples/complex-plane-rotation.md434342Good niche example; not central onboarding.
docs/user/examples/import-render-templates.md334342Useful migration note; legacy surface risk.
docs/user/examples/gemini-image-shorts.md434341Provider-specific and higher drift.
docs/user/examples/graphics-archetype-remake-plan.md445342Good plan doc; less directly runnable.
docs/user/examples/faceless-mixed-short.md445353Clear lane description; add runnable request block.
docs/user/examples/facts-listicle.md445353Clear lane description; add runnable request block.
docs/user/examples/micro-doc-breakdown.md445353Clear lane description; add runnable request block.
docs/user/examples/saas-problem-solution.md445353Clear lane description; add runnable request block.
docs/user/examples/stock-footage-edutainment.md445353Clear lane description; add runnable request block.
docs/user/examples/subway-confession-story.md445352Good example; term/source status can drift.
docs/user/examples/text-message-drama.md444352Good lane doc; add stronger reproduction path.

Dependent score for showcase -> runnable example -> provenance -> review: 3.5/5. The audit trail is strong. Reproducibility is uneven because some flagship pages describe outcomes better than commands or agent prompts.

Independent Ratings - Skills

DocPAudAccActScanMaintainabilityNotes
skills/README.md444332Complete catalog, but categories mix lanes, utilities, review, assets, and orchestration.
skills/_template/SKILL.md445454Good authoring baseline.
skills/generate-short/SKILL.md554543Strong primary orchestration skill.
skills/skill-catalog/SKILL.md453554Good discovery skill; entrypoint wording overstates runtime coverage.
skills/short-form-production-playbook/SKILL.md554454Strong craft/review guide.
skills/longform-to-shorts/SKILL.md444343Useful chain doc; needs clearer execution bridge to render inputs.
skills/longform-highlight-select/SKILL.md555554Strong runtime-backed stage doc.
skills/source-media-analyze/SKILL.md554553Strong runtime-backed stage doc.
skills/video-render/SKILL.md554543Good render contract; keep synced with harness schema.
skills/publish-prep-review/SKILL.md554543Good review gate; align naming with publish-prep alias.
skills/reddit-story-short/SKILL.md554443Strong lane doc.
skills/reddit-post-over-gameplay-short/SKILL.md554443Strong flagship lane doc.
skills/procedural-gameplay-backgrounds/SKILL.md554443Strong additive visual skill.
skills/motion-design-coder/SKILL.md554453Strong coding skill for motion systems.
skills/short-form-archetype-research/SKILL.md443321Powerful but too much reference fanout for fast routing.
skills/style-profile-library/SKILL.md334223Below the current skill readiness bar.
Runtime-backed pipeline skills554543brief-to-script, script-to-audio, timestamps-to-visuals, media-index, boundary-snap, and related stages are generally strong.
Review and retry skills554443Clear intent, but should be grouped separately from visual treatments.
Caption and timing skills554443Strong domain coverage; keep safe-zone and timestamp language consistent.
Source and rights skills444442Good coverage; external-source policies need ongoing maintenance.
Asset lifecycle skills444433Useful but spread across several categories.

Dependent score for user request -> skill selection -> runtime entrypoint -> artifact: 3.5/5. Individual skill docs are strong, but the catalog needs job-based grouping:

  • executable pipeline stages
  • content lanes/archetypes
  • production playbooks
  • caption/audio/timing
  • source governance and rights
  • asset lifecycle
  • review, retry, and regeneration
  • visual treatments and 3D/procedural graphics

Independent Ratings - Flows, Harness, And References

DocPAudAccActScanMaintainabilityNotes
flows/README.md543443Useful flow index; one entry skill is wrong.
flows/_template/FLOW.md445454Good expected-flow template.
flows/doctor.md442252Status claims do not match run-flow behavior.
flows/doctor.flow431151Critical drift: default output handling breaks run-scoped doctor calls.
flows/generate-short.md444444Good current executable flow doc.
flows/generate-short.flow434353Works, but under-lists supported runtime inputs.
flows/reverse-engineer-winner.md443353Describes follow-up skill call as part of flow, but runtime does not.
flows/reverse-engineer-winner.flow434354Manifest is mostly aligned with current runtime.
flows/showcase-content-machine.md543443Good operator note; ensure it mirrors manifest entry skill.
flows/showcase-content-machine.flow534353Manifest routes to generate-short, correctly.
scripts/harness/README.md554454Strong runtime map for contributors and agent harness authors.
docs/reference/REPO-FACTS.md435345Good generated source of truth.
docs/reference/ENVIRONMENT-VARIABLES.md445445Useful generated setup reference.
docs/reference/GLOSSARY.md545445Strong terminology source of truth.
docs/reference/QUALITY-GATES.md433343Generated, but coverage omits flows/*.md, flows/*.flow, and scripts/harness/README.md.
docs/reference/CONFIG-SURFACE.md435345Strong reference doc.
docs/reference/ARTIFACT-CONTRACTS.md334254Useful but less action-oriented.

Dependent score for flow doc -> .flow manifest -> run-flow -> artifacts: 2.5/5. The model is sound, but the doctor flow is currently the highest priority docs/runtime inconsistency.

Group Ratings - Large Doc Families

FamilyPAudAccActScanMaintainabilityNotes
docs/dev/architecture/443332Useful historical architecture; must keep demoted-surface status visible.
docs/dev/features/443332Valuable design history; high risk if mistaken for current behavior.
docs/dev/specs/443332Good design substrate; needs status labels.
docs/direction/443343Strong migration context; several historical docs need clearer non-authoritative labels.
docs/research/434222Important evidence corpus; too large to be part of default browsing.
docs/research/external/323111Imported material; should be quarantined from onboarding and default search.
archive/433233Good landing zone; archive boundary should remain explicit.

Dependent Ratings

ChainScoreResult
New visitor -> understands repo in one minute3Visual proof is strong, but root README has too many routes.
Agent install -> generated root instructions4Recent install docs are clear and mostly harness-agnostic.
Install -> verify -> generate -> review3Verification should move before generation in quickstart and harness docs.
Skill selection -> runtime-backed stage3.5Strong individual docs; catalog categories hide the shortest path.
Flow manifest -> run-flow execution2.5Doctor flow is broken; several operator notes overclaim.
Showcase -> example -> provenance -> review3.5Good audit chain; golden status conflicts with review-gate language.
Registry -> generated reference docs4Good source-of-truth model; generated coverage should include flow docs.
Active docs -> research/archive boundary3Boundary exists but huge research corpus dominates Markdown count.

Defect List

SeverityFindingEvidenceRecommended Fix
S1doctor.flow run-scoped output is inconsistent with doctor-report schema.flows/doctor.flow, src/harness/flow-runner.ts, src/harness/doctor-report.tsEither bind outputPath instead of outputDir, or let doctor-report accept outputDir. Then update doctor.md.
S1Resolved follow-up: golden showcase label needed matching OCR review evidence.docs/user/examples/reddit-post-over-gameplay.md, docs/user/QUALITY-AND-REVIEW.mdUpdated the demo-9 boxed caption render and docs after publish-prep caption-sync passed.
S2Root onboarding has too many competing starts.README.md headings around install, quick start, how to use, visitor map, docsCollapse to one golden path plus secondary links.
S2Quickstart places install-into-another-project after generation.docs/user/AGENT-QUICKSTART.mdMove install mode decision to the top and make external install an appendix after the first path is clear.
S2Verification is not consistently first-class.docs/user/AGENT-QUICKSTART.md, docs/user/AGENT-HARNESS-INSTALL.mdAdd one golden command chain: Node check, install, cm-agent list, doctor-report, generate, publish prep.
S2CONTRIBUTING.md quality wording drifts from package scripts.CONTRIBUTING.md, package.jsonAlign Node version and clarify that duplication check is separate unless added to npm run quality.
S2Direction doc is stale.DIRECTION.mdUpdate skill count and remove "new" wording where the pivot is now established.
S2Flow README lists showcase entry skill incorrectly.flows/README.md, flows/showcase-content-machine.flowChange table entry to generate-short.
S2Reverse-engineer flow doc describes a follow-up call that runtime does not execute.flows/reverse-engineer-winner.md, flows/reverse-engineer-winner.flowSeparate "current flow" from "next manual step".
S2Skill catalog categories mix unlike concepts.skills/README.mdReorganize by user job and pipeline role, not one flat catalog.
S2Status/maturity is duplicated across showcase, archetypes, examples, generated demo docs, and review docs.docs/user/showcase/README.md, docs/user/ARCHETYPES.md, docs/demo/README.mdGenerate status tables from one manifest.
S3Large imported research corpus can pollute repo search and mental model.docs/research/external/Add a short quarantine/index note and exclude from default doc navigation.
S3Older cm examples remain in user examples.Several docs/user/examples/*.md filesMark legacy examples or convert top examples to harness-first prompts.
S3style-profile-library skill is below the readiness pattern.skills/style-profile-library/SKILL.mdAdd standard sections, validation behavior, and clearer outputs.
  1. Fix executable drift: repair doctor.flow, correct flow README entry skill, and clarify reverse-engineer flow status.
  2. Tighten first-run docs: add one canonical golden command chain to AGENT-QUICKSTART.md and AGENT-HARNESS-INSTALL.md.
  3. Collapse README onboarding: keep the pitch and one path; move repeated surface explanations behind docs/user/README.md.
  4. Rework skill discovery: add a job-based matrix to skills/README.md before the exhaustive catalog.
  5. Unify showcase status: drive maturity labels from a single manifest and make golden, candidate, and experimental mechanically checkable.
  6. Label large doc families: make research/import/archive status visible so agents do not mistake evidence dumps for current user docs.

Signoff

This inspection found a strong documentation base with real product proof, agent install docs, skill docs, examples, and provenance. The next improvement is not more prose. The next improvement is reducing drift and making one obvious path for a new reader or agent.