Agent Learning Kit Documentation

August 18, 2026 · View on GitHub

Local-first testing, simulation, red teaming, and optimization for AI agents. Every cookbook below is a thin narrative over a runnable object in examples/ and is admitted by the docs_executability release gate — the YAML frontmatter at the top of each page is its manifest twin.

The spine

One loop, taught once:

simulate ──▶ evaluate ──▶ optimize ──▶ promote ──▶ prove

Each stage opens with a task guide; red-teaming is the fourth workflow, not a fourth engine — it rides on the simulate and evals engines, so its pages sit in the simulate and evaluate rows of the index below.

StageStart here
SimulateSimulate any framework
EvaluateEvaluate any task
OptimizeOptimize any agent
Red-teamRed-team anything
Promote · ProveRegression lifecycle · Trinity suite

Pick a cookbook (stage × objective)

Rows are the spine; columns are what you care about. This is the compact mirror — the full 70-page index (every Markdown page under docs/, the same set docs/llms.txt lists) is cookbooks/index.md.

BehaviorCapabilityReliabilitySafety
simulatespec-and-runner · first-run · worlds-and-hookssimulate-any-framework · 14 framework pagesmulti-agent · orchestrationfirst-campaign · stored-prompt-injection
evaluateeval-suites · artifact-evalstask-evidencejudge-reliabilitycausal-attribution
optimizeoptimization-lifecycleworkflow-profile-matrixgovernance · optimizer-portfoliosociety-of-agents
promoteregression-lifecyclepromote-to-regressionattack-evolution-shrinkpromote-to-regression
provetrinity-suitecapabilitiesrelease-check-in-your-citrust-certificates

Golden paths

First replayable artifact in three commands or fewer, offline — no API keys, no provider accounts:

agent-learn init . --preset run --quiet
agent-learn run manifests/run.json --output artifacts/run.json
python -c "import json; assert json.load(open('artifacts/run.json'))['kind']=='agent-learning.run.v1'; print('ok')"

Layer vocabulary

If you arrive from the agent-infrastructure literature (memory, skills/tools, protocols, harness engineering), this maps that vocabulary onto kit surfaces:

LayerKit pages
memoryoptimize/memory-targets · simulate/memory
skills / toolsprove/actions · redteam/first-campaign
protocolframeworks/mcp · frameworks/a2a · frameworks/openenv
harnessprove/release-check-in-your-ci · quickstart pages

How these docs stay honest

Every page's frontmatter names its backing example, the artifact kind it emits, and the postcondition that checks the result. agent-learn release-check re-verifies all of it on every release: a page whose backing object stops running cannot ship. Superlative phrasing is linted the same way — a claim appears in prose only when a named release gate licenses it in the same run. The artifact contract is cataloged in reference/artifacts.md; the release proof objects are described in the README's Project Status section.

Framework coverage wording, copied verbatim from the README:

  • Framework adapter probes (probe-promoted coverage) for LangChain, LangGraph, LlamaIndex, AutoGen, CrewAI, LiveKit, Pipecat, Browser Use, MCP, A2A, and custom orchestration objects.
  • Runtime-simulated coverage for PydanticAI (multi-framework runtime simulation) and OpenAI Agents (handoff-transcript promotion).