Is this page helpful?

Observability for GenMol NIM#

Use this page to monitor GenMol NIM health and metrics, and to configure telemetry behavior.

Health Endpoints#

GenMol NIM exposes standard health endpoints for readiness and liveness checks.

Readiness#

Endpoint path: /v1/health/ready

curl http://localhost:8000/v1/health/ready

Liveness#

Endpoint path: /v1/health/live

curl http://localhost:8000/v1/health/live

Metrics Endpoint#

GenMol NIM exposes runtime metrics at:

Endpoint path: /v1/metrics

curl http://localhost:8000/v1/metrics

This endpoint can be scraped by Prometheus-compatible tooling and integrated with observability pipelines such as OpenTelemetry Collector.

Telemetry Control#

Telemetry collection is optional and disabled by default.

  • Set NIM_TELEMETRY_MODE=0 to disable telemetry (default)

  • Set NIM_TELEMETRY_MODE=1 to enable telemetry

Telemetry is intended to help improve performance, reliability, and compatibility across deployments while preserving user privacy.