Agent System Architecture

July 5, 2026 · View on GitHub

Implementation Status

The FeatureAgent LangGraph graph is implemented at packages/core/src/infrastructure/services/agents/feature-agent/ with background execution support, validation/repair loops, and human-in-the-loop approval. The AnalyzeRepository graph is implemented at packages/core/src/infrastructure/services/agents/analyze-repo/. The Supervisor agent (spec 093) is implemented at packages/core/src/infrastructure/services/agents/supervisor-agent/ and is gated behind the collaboration feature flag — see supervision. The DevServerAgent graph (spec 103) is implemented at packages/core/src/infrastructure/services/agents/dev-server-agent/ — it replaces the deterministic-only, blocking-install "start dev server" flow and supersedes the dormant spec-068 prototype.

See AGENTS.md for full implementation details including the directory structure, state schema, graph flow, and node descriptions.


Settings-Driven Agent Resolution (MANDATORY -- Applies to All Architecture)

ARCHITECTURAL RULE: Whether using the current executor-based system or the planned LangGraph system, agent type resolution MUST always come from getSettings().agent.type via AgentExecutorFactory.createExecutor(). No node, graph, use case, or worker may hardcode, guess, or default an agent type. This rule applies to ALL current and future agent implementations.

See AGENTS.md -- Settings-Driven Agent Resolution for the full rule and resolution flow.


Architecture

Multi-stage workflow orchestration using LangGraph StateGraphs with agent-agnostic execution. The FeatureAgent and AnalyzeRepository graphs are implemented; the multi-agent supervisor pattern is planned.

Overview

Shep implements a state-based workflow system using LangGraph for multi-stage feature development. Nodes are pure async functions that process and update state. Agent execution is delegated to an IAgentExecutor implementation (Claude Code, Gemini CLI, Aider, Cursor, etc.) resolved via settings.

+-----------------------------------------+
|     FeatureWorkflow (StateGraph)        |
+-----------------------------------------+
|                                         |
|  [Analyze] --> [Gather Req] --> [Plan]  |
|                     |                   |
|                 (loop until             |
|                  clear)                 |
|                     |                   |
|                     v                   |
|              [Implement] --> [END]      |
|                                         |
|  State: typed, immutable updates        |
|  Execution: IAgentExecutor (delegated)  |
|                                         |
+-----------------------------------------+

Design Principles

  1. State-Driven: All workflow state flows through a typed schema
  2. Pure Functions: Nodes are deterministic, side-effect-free async functions
  3. Explicit Edges: Flow control via direct or conditional edges (no hidden routing)
  4. Agent-Agnostic: Execution delegated to IAgentExecutor implementations resolved via settings
  5. Type Safe: TypeScript Annotations with Zod validation for tool parameters
  6. Observable: Full execution history via checkpoints

Core Concepts

StateGraph

Typed workflow definition using LangGraph's StateGraph:

import { Annotation } from '@langchain/langgraph';

export const FeatureState = Annotation.Root({
  repoPath: Annotation<string>,
  requirements: Annotation<Requirement[]>({
    reducer: (prev, next) => [...prev, ...next],
    default: () => [],
  }),
  plan: Annotation<Plan | null>,
  tasks: Annotation<Task[]>({
    reducer: (prev, next) => [...prev, ...next],
    default: () => [],
  }),
  messages: Annotation<string[]>({
    reducer: (prev, next) => [...prev, ...next],
    default: () => [],
  }),
});

export type FeatureStateType = typeof FeatureState.State;

Nodes

Functions that process and update state by delegating to IAgentExecutor:

function createAnalyzeNode(executor: IAgentExecutor) {
  return async (
    state: AnalyzeRepositoryStateType
  ): Promise<Partial<AnalyzeRepositoryStateType>> => {
    const prompt = buildAnalyzePrompt(state.repositoryPath);
    const result = await executor.execute(prompt, {
      cwd: state.repositoryPath,
    });
    return { analysisMarkdown: result.result };
  };
}

Edges

Connections defining workflow progression:

// Direct edge: always go from A to B
graph.addEdge('analyze', 'requirements');

// Conditional edge: choose based on state
graph.addConditionalEdges('requirements', (state) => {
  if (allRequirementsClear(state)) return 'plan';
  return 'requirements'; // Loop back for clarification
});

Implemented Graphs

AnalyzeRepository Graph

Located at packages/core/src/infrastructure/services/agents/analyze-repo/. Single-node graph that generates a repository analysis document.

FeatureAgent Graph

Located at packages/core/src/infrastructure/services/agents/feature-agent/. Full SDLC workflow graph with:

  • Background process execution via worker
  • Heartbeat monitoring
  • Phase timing tracking
  • Human-in-the-loop approval gates
  • Lifecycle context management

Key files:

  • feature-agent-graph.ts -- Full SDLC graph definition
  • fast-feature-agent-graph.ts -- Simplified fast-mode graph
  • feature-agent-process.service.ts -- Process management
  • feature-agent-worker.ts -- Background worker (also emits parallel AgentQuestion of kind = blocking on every waiting_approval transition for the unified inbox)
  • state.ts -- State annotation
  • nodes/ -- Individual node implementations

Supervisor Agent Graph (spec 093, flag-gated)

Located at packages/core/src/infrastructure/services/agents/supervisor-agent/. A delegated guardian agent that evaluates approval gates and agent questions on behalf of the user. Gated behind FeatureFlags.collaboration. See supervision.md for the full design.

Key files:

  • supervisor-graph.ts -- LangGraph workflow: ingest-eventload-policyevaluate (LLM via IAgentExecutorProvider) → emit-decision → optional publish-message
  • supervisor-agent-worker.ts -- Lazy per-(appId, featureId?) background worker, mirrors the feature-agent-worker shape (own agent_runs row with agent_type='supervisor', heartbeat, checkpointing)
  • evaluator-prompt.ts -- Versioned prompt registry; the version is recorded on every SupervisorDecision
  • stub-supervisor-executor.ts -- Deterministic stub (InMemorySupervisorAgent) used by tests so unit / integration coverage runs without an LLM call

Dev-Server Agent Graph (spec 103)

Located at packages/core/src/infrastructure/services/agents/dev-server-agent/. Converts "start dev server" from a deterministic-only, blocking-install pipeline into a bounded LangGraph agent that analyzes the repository, provisions missing infrastructure and dependencies, starts the server with an explicit run plan, and verifies readiness -- with agent-driven remediation on failure. It supersedes the dormant spec-068 prototype (AgentDeploymentService / DevEnvironmentAgentService, both deleted); IStructuredAgentCaller is the one piece of that prototype that remains, shared across graphs.

START → analyze → ensure_infra → install_deps → start_server → verify → END
                       ▲                │                         │
                       └── remediate ◄──┴─────────────────────────┘
  • analyze / ensure_infra failures are terminal (straight to END with failureReason set) -- neither is remediated by the loop.
  • install_deps / verify failures route to remediate while attempts remain (MAX_REMEDIATION_ATTEMPTS = 2); remediate loops back to ensure_infra. Exhaustion terminates with the last failureReason.

State channels (state.ts):

ChannelTypeSemantics
targetId/targetType/targetPathstringInvoke-time inputs, set once
runPlanDevServerRunPlan | nullResolved plan (cache / deterministic / agent); last-write-wins
infraReadybooleanSet by ensure_infra once required binaries are confirmed present
depsInstalledbooleanSet by install_deps once dependencies are installed or fresh
resultUrlstring | nullTerminal success signal, written by verify
failureReasonstring | nullTerminal failure signal; remediate explicitly writes null to retry
remediationAttemptsnumberRouting budget, incremented by remediate
lastErrorTailstring[]Tail of the most recent failed command's output; replaced per failure
capturedLogsstring[]Append-only accumulator of every node's progress lines
degradedbooleanTrue once any node ran without an agent executor / structured caller

Ports used:

PortConsumed byPurpose
IAgentExecutorProviderDevServerAgentServiceLazily resolves the IAgentExecutor wired into ensure_infra/remediate; a missing or throwing provider degrades to null (deterministic-only) rather than failing the run
IStructuredAgentCalleranalyze nodeSchema-validated repository analysis (RUN_PLAN_ANALYSIS_SCHEMA) when deterministic detection can't resolve a command; null forces deterministic-only analysis
IDevServerRunPlanRepositoryanalyze, install_deps, remediate nodesPer-repo run-plan cache: findByRepoPath/upsert/stampInstallHash/deleteByRepoPath
IDeploymentServicestart_server/verify nodes, DevServerAgentServicesetTransientState (Analyzing/Installing), appendLog (SSE bridge), start() with a RunPlanOverride, getStatus/getLogs

Fast path and degradation. analyze resolves a run plan cheapest-first: (1) a cached plan whose configHash still matches the repo's manifest fingerprint, (2) detectDevScript() deterministic package.json detection -- both make zero LLM calls -- and only on a Tier-1/2 miss, (3) a structured IStructuredAgentCaller.call() against RUN_PLAN_ANALYSIS_SCHEMA. DevServerAgentService (the IDevServerAgentService implementation) resolves the executor and structured caller lazily; either being unavailable (or throwing) degrades the whole run to deterministic-only instead of failing -- degraded: true is set on the state, and if deterministic detection also fails, the run terminates with an actionable failureReason instead of an agent call.

Remediation bounds. ensure_infra performs its own one-shot, user-space, non-interactive remediation for missing binaries (ahead of the graph-level loop) and re-probes just the binaries that were missing. The graph-level loop is bounded by MAX_REMEDIATION_ATTEMPTS = 2 (dev-server-agent-graph.ts): on an install_deps or verify failure, remediate invalidates the cached run plan (deleteByRepoPath -- the plan may be the cause), runs one bounded agent execution seeded with the failure reason and error tail, and on success explicitly overwrites failureReason: null (the reducer lets an explicit null override the previous value) so the graph loops back through ensure_infra and retries. An executor throw, or exhausted attempts, terminates the run with the last failureReason.

Run-plan cache. Plans persist in the additive dev_server_run_plans table (repoPath primary key, RunPlanSource.Deterministic | Agent), invalidated by configHash -- a fingerprint of the repo's manifest/lockfile inventory (computeConfigHash). A stale configHash triggers re-detection/re-analysis and replaces the cached row. Install staleness uses a separate installStampHash (computeInstallHash, the strongest single lockfile/manifest signal), stamped only after a fully successful install -- covering both the package-manager install and the plan's setupCommands -- so a fresh hit skips both on the next run.

Key files:

  • dev-server-agent-graph.ts -- Graph wiring, routing functions, MAX_REMEDIATION_ATTEMPTS
  • dev-server-agent.service.ts -- IDevServerAgentService implementation: fire-and-track accept contract, single-flight per targetId, executor resolution, node composition
  • state.ts -- State annotation
  • nodes/ -- analyze, ensure-infra, install-deps, start-server, verify, remediate node factories (+ prompts/ for the analysis and remediation prompts)
  • schemas/run-plan-analysis.schema.ts -- RUN_PLAN_ANALYSIS_SCHEMA / DevServerAnalysis

Collaboration & Question Pipeline (spec 093, flag-gated)

Three new domain entities — defined in tsp/agents/ — extend the agent system with structured inter-agent messaging and a unified question/escalation pipeline. All are gated behind the collaboration feature flag.

EntitySourceStorage
AgentMessagetsp/agents/agent-message.tspagent_messages (migration 087)
AgentQuestiontsp/agents/agent-question.tspagent_questions (migration 088)
SupervisorPolicytsp/agents/supervisor-policy.tspsupervisor_policies (migration 089)
SupervisorDecisiontsp/agents/supervisor-decision.tspsupervisor_decisions (migration 090) + mirrored to activity_log

New ports:

PortPath
IAgentMessageBuspackages/core/src/application/ports/output/agents/agent-message-bus.interface.ts
IAgentQuestionServicepackages/core/src/application/ports/output/agents/agent-question-service.interface.ts
ISupervisorAgentpackages/core/src/application/ports/output/agents/supervisor-agent.interface.ts
IAgentMessageRepositorypackages/core/src/application/ports/output/repositories/agent-message-repository.interface.ts
IAgentQuestionRepositorypackages/core/src/application/ports/output/repositories/agent-question-repository.interface.ts
ISupervisorPolicyRepositorypackages/core/src/application/ports/output/repositories/supervisor-policy-repository.interface.ts
ISupervisorDecisionRepositorypackages/core/src/application/ports/output/repositories/supervisor-decision-repository.interface.ts

New use cases (under packages/core/src/application/use-cases/agents/):

SendAgentMessage, ListAgentMessages, AskAgentQuestion, AnswerAgentQuestion, CancelAgentQuestion, ListAgentQuestions, EscalateToUser, ConfigureSupervisor, EnableSupervisor, DisableSupervisor, GetSupervisorPolicy, EvaluateSupervisorDecision.

ApproveAgentRunUseCase and RejectAgentRunUseCase are extended to recognise the supervisor:<id> actor namespace and to enforce the "user always wins" invariant. See supervision.md for the full sequence diagrams.

Three new SSE event kinds — agent_message, agent_question, supervisor_decision — are streamed through StreamAgentEventsUseCase via dedicated compute helpers (compute-message-deltas.ts, compute-question-deltas.ts, compute-decision-deltas.ts).

Agent Executor Interfaces

The agent system uses these key interfaces (defined in packages/core/src/application/ports/output/agents/):

InterfacePurpose
IAgentExecutorExecute prompts against an AI coding agent
IAgentExecutorFactoryCreate executor instances for a given agent type
IAgentExecutorProviderResolve the current executor from settings
IAgentRegistryRegister and discover agent definitions
IAgentRunnerRun agent workflows with lifecycle management
IAgentValidatorValidate agent tool availability
IFeatureAgentProcessServiceManage feature agent background processes
IStructuredAgentCallerMake structured (typed) calls to agents

Workflow Stages

StageNodeResponsibility
AnalyzeanalyzeNodeParse codebase structure, patterns, tech stack
RequirementsrequirementsNodeGather requirements via conversation, validate clarity
PlanplanNodeDecompose into tasks, create artifacts (PRD, RFC, Tech Plan)
ImplementimplementNodeExecute tasks respecting dependency graph

Practical Example

For implementation details, see docs/development/adding-agents.md.


Maintaining This Document

Update when:

  • StateGraph structure changes
  • New workflow stages added
  • Node functions added or modified
  • New agent executor types added

Related docs: