OmniMemEval Tests

July 24, 2026 ยท View on GitHub

The public test suite covers both evaluation tracks, shared utilities, memory adapter configuration, pipeline contracts, and integration smoke helpers.

User Memory and Shared Tests

conda run -n omnimemeval python -m unittest discover -s scripts/tests -p 'test_*.py'
conda run -n omnimemeval python -m unittest discover -s scripts/tests/unit -p 'test_*.py'
conda run -n omnimemeval python -m unittest discover -s scripts/tests/pipeline -p 'test_*.py'

Agent Memory Unit Tests

Agent Memory uses the separate agentmem environment. Focused AgentBench unit tests can be selected without running real tasks:

conda run -n agentmem python -m unittest discover -s scripts/tests/unit -p 'test_agentbench_*.py'

Integration Smoke Tests

Integration smoke tests require real backend credentials:

conda run -n omnimemeval python scripts/tests/integration/smoke_clients.py --lib memos --env .env.memos