Guest MIG Reconfiguration

To replace compute instances created when the GPU was configured for MIG-backed vGPUs, delete the ones you do not need, then add compute instances from within the guest VM. These steps are run by the guest VM owner inside the VM, after the hypervisor administrator has completed Host MIG Provisioning.

Note

• From a guest VM you can change configuration only for MIG-backed vGPUs that use a whole GPU instance. For time-sliced MIG-backed vGPUs, create compute instances on the host as described in Creating Non-Default Compute Instances in a GPU Instance for 1:1 vGPUs.

• For B300 HGX / B200 HGX Compute Instance combination restrictions on full-sized (7-slice) GPU Instances, see the MIG-backed vGPU constraints note.

A MIG-backed vGPU that occupies an entire GPU instance is assigned all of the instance’s framebuffer. For such vGPUs, the maximum vGPUs per GPU instance in the tables in Virtual GPU Types for Supported GPUs is always 1. For architecture-specific vGPU type tables, refer to Blackwell, Hopper, Ada Lovelace, or Ampere.

Prerequisites

• You have root user privileges in the guest VM.

• Other processes, such as CUDA applications, monitoring applications, or the nvidia-smi command, do not use the GPU instance.

Steps

1. In the guest VM, open a command shell as root (SSH or the guest console).

2. List the available GPU instances.

   $ nvidia-smi mig -lgi
       +----------------------------------------------------+
       | GPU instances:                                     |
       | GPU   Name          Profile  Instance   Placement  |
       |                       ID       ID       Start:Size |
       |====================================================|
       |   0  MIG 2g.10gb       0        0          0:8     |
       +----------------------------------------------------+
   

3. Optional: If compute instances were created when the GPU was configured for MIG-backed vGPUs that you no longer require, delete them.

   $ nvidia-smi mig -dci -ci compute-instance-id -gi gpu-instance-id
   

   compute-instance-id - The ID of the compute instance that you want to delete.

   gpu-instance-id - The ID of the GPU instance from which you want to delete the compute instance.

   Note

   This command fails if another process is using the GPU instance. In this situation, stop all processes using the GPU instance and retry the command.

   This example deletes compute instance 0 from GPU instance 0 on GPU 0.

   $ nvidia-smi mig -dci -ci 0 -gi 0
   Successfully destroyed compute instance ID  0 from GPU  0 GPU instance ID  0
   

4. List the compute instance profiles that are available for your GPU instance.

   $ nvidia-smi mig -lcip
   

   This example shows that one MIG 2g.10gb compute instance or two MIG 1c.2g.10gb compute instances can be created within the GPU instance.

   $ nvidia-smi mig -lcip
       +-------------------------------------------------------------------------------+
       | Compute instance profiles:                                                    |
       | GPU    GPU      Name          Profile  Instances   Exclusive      Shared      |
       |      Instance                   ID     Free/Total     SM      DEC   ENC   OFA |
       |        ID                                                     CE    JPEG      |
       |===============================================================================|
       |   0     0       MIG 1c.2g.10gb   0      2/2           14       1     0     0  |
       |                                                                2     0        |
       +-------------------------------------------------------------------------------+
       |   0     0       MIG 2g.10gb      1*     1/1           28       1     0     0  |
       |                                                                2     0        |
       +-------------------------------------------------------------------------------+
   

5. Create each compute instance you need inside the available GPU instance (run the command once per instance).

   $ nvidia-smi mig -cci compute-instance-profile-id -gi gpu-instance-id
   

   compute-instance-profile-id - The compute instance profile ID that specifies the compute instance.

   gpu-instance-id - The GPU instance ID specifies the GPU instance within which you want to create the compute instance.

   Note

   This command fails if another process is using the GPU instance. In this situation, stop all GPU processes and retry the command.

   This example creates a MIG 2g.10gb compute instance on GPU instance 0.

   $ nvidia-smi mig -cci 1 -gi 0
   Successfully created compute instance ID  0 on GPU  0 GPU instance ID  0 using profile MIG 2g.10gb (ID  1)
   

   This example creates two MIG 1c.2g.10gb compute instances on GPU instance 0 by running the same command twice.

   $ nvidia-smi mig -cci 0 -gi 0
   Successfully created compute instance ID  0 on GPU  0 GPU instance ID  0 using profile MIG 1c.2g.10gb (ID  0)
   $ nvidia-smi mig -cci 0 -gi 0
   Successfully created compute instance ID  1 on GPU  0 GPU instance ID  0 using profile MIG 1c.2g.10gb (ID  0)
   

6. Verify compute instances in the GPU instance with nvidia-smi. This output shows a MIG 2g.10gb compute instance on GPU instance 0.

   nvidia-smi
     Mon Mar 25 19:01:24 2024
     +-----------------------------------------------------------------------------+
     | NVIDIA-SMI 595.58.03    Driver Version: 595.58.03   CUDA Version:  13.0     |
     |-------------------------------+----------------------+----------------------+
     | GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
     | Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
     |                               |                      |               MIG M. |
     |===============================+======================+======================|
     |   0  GRID A100X-2-10C     On  | 00000000:00:08.0 Off |                   On |
     | N/A   N/A    P0    N/A /  N/A |   1058MiB / 10235MiB |     N/A      Default |
                                      |                      |              Enabled |
     +-------------------------------+----------------------+----------------------+
   
     +-----------------------------------------------------------------------------+
     | MIG devices:                                                                |
     +------------------+----------------------+-----------+-----------------------+
     | GPU  GI  CI  MIG |         Memory-Usage |        Vol|         Shared        |
     |      ID  ID  Dev |           BAR1-Usage | SM     Unc| CE  ENC  DEC  OFA  JPG|
     |                  |                      |        ECC|                       |
     |==================+======================+===========+=======================|
     |  0    0   0   0  |   1058MiB / 10235MiB | 28      0 |  2   0    1    0    0 |
     |                  |      0MiB /  4096MiB |           |                       |
     +------------------+----------------------+-----------+-----------------------+
   
     +-----------------------------------------------------------------------------+
     | Processes:                                                                  |
     |  GPU   GI   CI        PID   Type   Process name                  GPU Memory |
     |        ID   ID                                                   Usage      |
     |=============================================================================|
     |  No running processes found                                                 |
     +-----------------------------------------------------------------------------+
   

   This example confirms that two MIG 1c.2g.10gb compute instances were created on GPU instance 0.

   $ nvidia-smi
       Mon Mar 25 19:01:24 2024
       +-----------------------------------------------------------------------------+
       | NVIDIA-SMI 595.58.03    Driver Version: 595.58.03   CUDA Version:  13.0     |
       |-------------------------------+----------------------+----------------------+
       | GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
       | Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
       |                               |                      |               MIG M. |
       |===============================+======================+======================|
       |   0  GRID A100X-2-10C     On  | 00000000:00:08.0 Off |                   On |
       | N/A   N/A    P0    N/A /  N/A |   1058MiB / 10235MiB |     N/A      Default |
       |                               |                      |              Enabled |
       +-------------------------------+----------------------+----------------------+
   
       +-----------------------------------------------------------------------------+
       | MIG devices:                                                                |
       +------------------+----------------------+-----------+-----------------------+
       | GPU  GI  CI  MIG |         Memory-Usage |        Vol|         Shared        |
       |      ID  ID  Dev |           BAR1-Usage | SM     Unc| CE  ENC  DEC  OFA  JPG|
       |                  |                      |        ECC|                       |
       |==================+======================+===========+=======================|
       |  0    0   0   0  |   1058MiB / 10235MiB | 14      0 |  2   0    1    0    0 |
       |                  |      0MiB /  4096MiB |           |                       |
       +------------------+                      +-----------+-----------------------+
       |  0    0   1   1  |                      | 14      0 |  2   0    1    0    0 |
       |                  |                      |           |                       |
       +------------------+----------------------+-----------+-----------------------+
   
       +-----------------------------------------------------------------------------+
       | Processes:                                                                  |
       |  GPU   GI   CI        PID   Type   Process name                  GPU Memory |
       |        ID   ID                                                   Usage      |
       |=============================================================================|
       |  No running processes found                                                 |
       +-----------------------------------------------------------------------------+
   

Related Topics

• Host MIG Provisioning — hypervisor-side MIG enablement and GPU/Compute Instance creation

• Creating Non-Default Compute Instances in a GPU Instance for 1:1 vGPUs — host-side counterpart for time-sliced MIG-backed vGPUs

• Virtual GPU Types for Supported GPUs — per-architecture vGPU type tables