Observability
NIM provides Prometheus metrics indicating request statistics. These metrics can be used to create dashboards with the Grafana dashboard. By default, these metrics are available at http://0.0.0.0:8000/v1/metrics .
You can use the following command to retrieve the metrics:
The following table describes the available metrics.