NVIDIA vGPU Alert Definitions#
The management pack provides alert definitions for the NVIDIA vGPU metrics and analytics that it integrates with VMware Aria Operations. Each alert definition is a combination of symptoms that identify a problem area and generate alerts for that area.
Alerts defined for GPU utilization can be generated by any of the GPU engines, namely:
3D/Compute
Memory controller
Video encoder
Video decoder
GPU Utilization Is High#
This alert is generated when the utilization of any of the GPU engines is high.
Symptom |
Associated Metric |
Criticality |
Threshold |
|---|---|---|---|
GPU 3D/Compute Utilization is critically high |
GPU: Utilization|3D/Compute Utilization |
Immediate |
90 |
GPU 3D/Compute Utilization is moderately high |
GPU: Utilization|3D/Compute Utilization |
Warning |
75 |
GPU Memory Utilization is critically high |
GPU: Utilization|Memory Utilization |
Immediate |
90 |
GPU Memory Utilization is moderately high |
GPU: Utilization|Memory Utilization |
Warning |
75 |
GPU Encoder Utilization is critically high |
GPU: Utilization|Encoder Utilization |
Immediate |
90 |
GPU Encoder Utilization is moderately high |
GPU: Utilization|Encoder Utilization |
Warning |
75 |
GPU Decoder Utilization is critically high |
GPU: Utilization|Decoder Utilization |
Immediate |
90 |
GPU Decoder Utilization is moderately high |
GPU: Utilization|Decoder Utilization |
Warning |
75 |
vGPU Utilization Is High#
This alert is generated when the utilization of any of the GPU engines is high on any virtual GPU.
Symptom Name |
Associated Metric |
Criticality |
Threshold |
|---|---|---|---|
vGPU 3D/Compute Utilization is critically high |
vGPU: Utilization|3D/Compute Utilization |
Immediate |
90 |
vGPU 3D/Compute Utilization is moderately high |
vGPU: Utilization|3D/Compute Utilization |
Warning |
75 |
vGPU Memory Utilization is critically high |
vGPU: Utilization|Memory Utilization |
Immediate |
90 |
vGPU Memory Utilization is moderately high |
vGPU: Utilization|Memory Utilization |
Warning |
75 |
vGPU Encoder Utilization is critically high |
vGPU: Utilization|Encoder Utilization |
Immediate |
90 |
vGPU Encoder Utilization is moderately high |
vGPU: Utilization|Encoder Utilization |
Warning |
75 |
vGPU Decoder Utilization is critically high |
vGPU: Utilization|Decoder Utilization |
Immediate |
90 |
vGPU Decoder Utilization is moderately high |
vGPU: Utilization|Decoder Utilization |
Warning |
75 |
vGPU Utilization Is High for Process#
This alert is generated when the utilization of any of the GPU engines is high for any process on any virtual GPU.
Symptom Name |
Associated Metric |
Criticality |
Threshold |
|---|---|---|---|
vGPU 3D/Compute Utilization is critically high for Process |
Process: 3D/Compute Utilization |
Immediate |
90 |
vGPU 3D/Compute Utilization is moderately high for Process |
Process: 3D/Compute Utilization |
Warning |
75 |
vGPU Memory Utilization is critically high for Process |
Process: Memory Utilization |
Immediate |
90 |
vGPU Memory Utilization is moderately high for Process |
Process: Memory Utilization |
Warning |
75 |
vGPU Encoder Utilization is critically high for Process |
Process: Encoder Utilization |
Immediate |
90 |
vGPU Encoder Utilization is moderately high for Process |
Process: Encoder Utilization |
Warning |
75 |
vGPU Decoder Utilization is critically high for Process |
Process: Decoder Utilization |
Immediate |
90 |
vGPU Decoder Utilization is moderately high for Process |
Process: Decoder Utilization |
Warning |
75 |
GPU Temperature Is High#
This alert is generated when the GPU temperature is high enough to force slowdown or shutdown.
Symptom |
Associated Metric |
Criticality |
Threshold |
|---|---|---|---|
GPU Temperature is forcing slowdown |
GPU: Temperature|Current Temperature |
Critical |
Slowdown Temperature |
GPU Temperature is forcing shutdown |
GPU: Temperature|Current Temperature |
Immediate |
Shutdown Temperature minus 5 |