Skip to navigation

Observability for GenMol NIM

View as Markdown

Use this page to monitor GenMol NIM health and metrics, and to configure telemetry behavior.

Health Endpoints

GenMol NIM exposes standard health endpoints for readiness and liveness checks.

Readiness

Endpoint path: /v1/health/ready

curl http://localhost:8000/v1/health/ready

Liveness

Endpoint path: /v1/health/live

curl http://localhost:8000/v1/health/live

Metrics Endpoint

GenMol NIM exposes runtime metrics at:

Endpoint path: /v1/metrics

curl http://localhost:8000/v1/metrics

This endpoint can be scraped by Prometheus-compatible tooling and integrated with observability pipelines such as OpenTelemetry Collector.

Telemetry Control

Telemetry collection is optional and disabled by default.

  • Set NIM_TELEMETRY_MODE=0 to disable telemetry (default)
  • Set NIM_TELEMETRY_MODE=1 to enable telemetry

Telemetry is intended to help improve performance, reliability, and compatibility across deployments while preserving user privacy.