baselines/
June 8, 2026 · View on GitHub
This folder holds the upstream source code of every memory-system
baseline MemoryBench depends on. The Python code under ../src/agent/
imports directly from these directories, so they must be present on disk
for the corresponding baselines to load.
What's here
| Folder | Upstream | How it ships |
|---|---|---|
A_mem/ | https://github.com/agiresearch/A-mem | Tracked in git |
MemoryOS/ | https://github.com/BAI-LAB/MemoryOS | Tracked in git |
mem0/ | https://github.com/mem0ai/mem0 | Tracked in git (editable install — see below) |
AutoSkill/ | https://github.com/ECNU-ICALK/AutoSkill | Tracked in git |
Why these are vendored
The baselines src/agent/*.py actually imports from (a_mem, mem0,
memoryos) are vendored in-tree so a fresh git clone of
MemoryBench is enough to run experiments — no extra fetching, no submodule
dance.
A baseline that reimplements its algorithm in MemoryBench style (no
upstream import) needs no vendored source at all. If you keep the upstream
around purely for code-reading, treat it as a reference-only mirror:
keep it on your machine and list the folder in the top-level
.gitignore so git status stays clean.
Editable-install requirement for mem0
baselines/mem0/ is consumed as a Python package via the imports in
../src/agent/mem0.py. After cloning MemoryBench
you have to install it once in editable mode:
cd baselines/mem0
pip install -e .
This is documented in the top-level README.md under "Environment Setup".
Adding a new upstream baseline
If your baseline's MemoryBench agent imports from an upstream package
(like mem0 and a_mem do), vendor the upstream source here so a fresh
clone runs without extra fetch steps:
cd baselines/
git clone --depth 1 https://github.com/<org>/<repo>.git <Name>
rm -rf <Name>/.git # drop the nested .git so the outer repo can track files
git add <Name>
If your baseline reimplements the algorithm in MemoryBench style (no
upstream import), keep the upstream as a reference-only mirror and add
the folder to .gitignore:
baselines/<Name>/
The walkthrough in ../CONTRIBUTING.md covers this trade-off in more detail.