Hopper H20 vGPU Types#

NVIDIA Hopper GPUs target large-scale AI, HPC, and analytics in virtualized infrastructure. Hopper adds a dedicated Transformer Engine, fourth-generation Tensor Cores, FP8 compute on supported SKUs, NVLink 4.0 where the board provides it, and high-bandwidth memory (HBM3 or HBM3e depending on product).

Physical GPUs per board: 1

The maximum number of vGPUs per board is the product of the maximum number of vGPUs per GPU and the number of physical GPUs per board.

Required license edition: NVIDIA AI Enterprise

See also

MIG-Backed NVIDIA vGPU for Compute

For details on GPU instance profiles, refer to the NVIDIA Multi-Instance GPU User Guide.

Time-Sliced NVIDIA vGPU for Compute

Intended use cases:

  • vGPUs with more than 40 GB of framebuffer: Training Workloads

  • vGPUs with 40 GB of framebuffer: Inference Workloads

These vGPU types support a single display with a fixed maximum resolution.

Table 107 MIG-Backed NVIDIA vGPU for Compute for NVIDIA H20 SXM5 141 GB#

Virtual GPU Type

Framebuffer (GB)

Maximum vGPUs per GPU

Slices per vGPU

Compute Instances per vGPU

Corresponding GPU Instance Profile

H20X-7-141C

141

1

7

7

MIG 7g.141gb

H20X-4-71C

71

1

4

4

MIG 4g.71gb

H20X-3-71C

71

2

3

3

MIG 3g.71gb

H20X-2-35C

35

3

2

2

MIG 2g.35gb

H20X-1-35C [1]

35

4

1

1

MIG 1g.35gb

H20X-1-18C

18

7

1

1

MIG 1g.18gb

H20X-1-18CME [1]

18

1

1

1

MIG 1g.18gb+me

Table 108 Time-Sliced NVIDIA vGPU for Compute for NVIDIA H20 SXM5 141 GB#

Virtual GPU Type

Framebuffer (GB)

Maximum vGPUs per GPU in Equal-Size Mode

Maximum vGPUs per GPU in Mixed-Size Mode

Maximum Display Resolution [2]

Virtual Displays per vGPU

H20X-141C

141

1

1

3840x2400

1

H20X-70C

70

2

2

3840x2400

1

H20X-35C

35

4

4

3840x2400

1

H20X-28C

28

5

5

3840x2400

1

H20X-17C

17

8

8

3840x2400

1

H20X-14C

14

10

10

3840x2400

1

H20X-8C

8

16

16

3840x2400

1

H20X-7C

7

20

20

3840x2400

1

H20X-4C

4

32

32

3840x2400

1

Table 109 MIG-Backed NVIDIA vGPU for Compute for NVIDIA H20 SXM5 96 GB#

Virtual GPU Type

Framebuffer (GB)

Maximum vGPUs per GPU

Slices per vGPU

Compute Instances per vGPU

Corresponding GPU Instance Profile

H20-7-96C

96

1

7

7

MIG 7g.96gb

H20-4-48C

48

1

4

4

MIG 4g.48gb

H20-3-48C

48

2

3

3

MIG 3g.48gb

H20-2-24C

24

3

2

2

MIG 2g.24gb

H20-1-24C [1]

24

4

1

1

MIG 1g.24gb

H20-1-12C

12

7

1

1

MIG 1g.12gb

H20-1-12CME [1]

12

1

1

1

MIG 1g.12gb+me

Table 110 Time-Sliced NVIDIA vGPU for Compute for NVIDIA H20 SXM5 96 GB#

Virtual GPU Type

Framebuffer (GB)

Maximum vGPUs per GPU in Equal-Size Mode

Maximum vGPUs per GPU in Mixed-Size Mode

Maximum Display Resolution [2]

Virtual Displays per vGPU

H20-96C

96

1

1

3840x2400

1

H20-48C

48

2

2

3840x2400

1

H20-32C

32

3

3

3840x2400

1

H20-24C

24

4

2

3840x2400

1

H20-16C

16

6

4

3840x2400

1

H20-12C

12

8

4

3840x2400

1

H20-8C

8

12

8

3840x2400

1

H20-6C

6

16

8

3840x2400

1

H20-4C

4

24

8

3840x2400

1

Footnotes