Is this page helpful?

Observability for NVIDIA NIM for Image OCR (NeMo Retriever OCR)#

Use this documentation to monitor NVIDIA NIM for Image OCR (NeMo Retriever OCR).

Prometheus Metrics#

The OCR NIM exposes metrics in Prometheus text format at /v1/metrics on the HTTP listen address. With the default NIM_SERVER_BIND_ADDR, the endpoint is http://localhost:8000/v1/metrics.

You can verify the endpoint with the following command:

curl http://localhost:8000/v1/metrics

Configure Prometheus to scrape the endpoint. For example:

scrape_configs:
  - job_name: ocr-nim
    metrics_path: /v1/metrics
    static_configs:
      - targets: ["<nim-host>:8000"]

NVIDIA NIM for Image OCR (NeMo Retriever OCR) does not export OpenTelemetry metrics or traces. NIM_ENABLE_OTEL and the OTEL_* environment variables do not enable OTLP export for this NIM.

Logs#

Use RUST_LOG to set the Rust tracing filter and LOG_FORMAT to select pretty, json, or compact output. For details, see Environment Variables for NVIDIA NIM for Image OCR (NeMo Retriever OCR).

To follow logs from a Docker container, run:

docker logs <container-id> -f

To follow logs from a pod on Kubernetes, run:

kubectl logs -n <namespace> <pod-name> -f