Is this page helpful?

Testing#

To run tests:

uv sync --group dev
uv run pytest
uv run pytest --cov=src/aiq_agent --cov-report=html
uv run pytest tests/path/to/test_file.py

# MCP uses its own project, environment, and lockfile.
uv sync --project mcp --extra dev
uv run --project mcp --extra dev pytest mcp/tests

Use mocks for external services; mark slow/integration tests with @pytest.mark.slow / @pytest.mark.integration as needed.

Refer to each benchmark’s README for details. The Customization guide has a short section on adding eval harnesses.

Debugging#

  • Verbose logging: ./scripts/start_cli.sh --verbose or set verbose: true in workflow config.

  • Phoenix tracing: Start phoenix serve, run the agent with Phoenix tracing enabled in config, then open http://localhost:6006.

  • Common issues: Import errors – ensure uv pip install -e .; auth – check env vars; tool not found – check config; pre-commit cache – pre-commit clean.

On this page