NeMo Auditor Microservice Deployment Guide#
Prerequisites#
Before deploying the microservice, ensure you have the following:
Docker and Docker Compose installed
NGC API key for accessing NVIDIA container registry
Access to LLM endpoints (local NIM or NVIDIA API)
Sufficient storage for generated artifacts
Deployment Options#
Choose one of the following deployment options based on your use case:
Parent Helm Chart
Deploy the microservice on Kubernetes.
Docker Compose
Deploy the microservice using Docker Compose for local development and testing.