Testing
August 21, 2026 ยท View on GitHub
To run tests:
uv sync --group dev
uv run pytest
uv run pytest --cov=src/aiq_agent --cov-report=html
uv run pytest tests/path/to/test_file.py
# MCP uses its own project, environment, and lockfile.
uv sync --project mcp --extra dev
uv run --project mcp --extra dev pytest mcp/tests
Use mocks for external services; mark slow/integration tests with @pytest.mark.slow / @pytest.mark.integration as needed.
Refer to each benchmark's README for details. The Customization guide has a short section on adding eval harnesses.
Debugging
- Relay logging: enabled by
workflow.relay.logging; inspect the console subscriber and configured ATOF/OTEL destinations. - Phoenix tracing: Start
uvx --from arize-phoenix phoenix serve, run the agent with Phoenix tracing enabled in config, then openhttp://localhost:6006. - Common issues: Import errors -- ensure
uv pip install -e .; auth -- check env vars; tool not found -- check config; pre-commit cache --pre-commit clean.