Source Structure

December 24, 2025 · View on GitHub

src/
├── benchmarks/      # Benchmark adapters (LoCoMo, LongMemEval, ConvoMem)
├── providers/       # Memory provider integrations (Supermemory, Mem0, Zep)
├── judges/          # LLM-as-judge implementations (OpenAI, Anthropic, Google)
├── orchestrator/    # Pipeline execution and checkpointing
│   └── phases/      # Individual phase runners (ingest, search, answer, evaluate)
├── prompts/         # Default judge prompts by question type
├── types/           # TypeScript interfaces
├── cli/             # CLI commands
├── server/          # Web UI server
└── utils/           # Config, logging, model utilities

Key Files

FilePurpose
types/provider.tsProvider interface
types/benchmark.tsBenchmark interface
types/judge.tsJudge interface
types/unified.tsShared data types (UnifiedSession, UnifiedQuestion)
types/prompts.tsPrompt type definitions
utils/models.tsModel configurations and aliases
utils/config.tsEnvironment config loading
prompts/defaults.tsDefault judge prompts