Prerequisites#

This page outlines the required hardware and software for each Cosmos component.

Hardware#

Predict2#

Use NVIDIA GPUs with Ampere architecture or newer, including RTX 30 Series and A100 GPUs. Refer to the Predict2 Model Matrix for the required number of GPUs and memory for inference and post-training.

Predict1#

Use NVIDIA H100-80GB or A100-80GB GPUs for inference and post-training. Refer to the Predict1 Model Matrix page for the required number of GPUs and memory for inference and post-training.

Transfer1#

Use NVIDIA GPUs with Ampere architecture or newer, including RTX 30 Series and A100 GPUs.

Reason1#

Use NVIDIA GPUs with Ampere architecture or newer, including RTX 30 Series and A100 GPUs. The following are the minimum GPU and memory values for inference and post-training:

  • Inference: 1 GPU with 24GB memory

  • Post-training: 4 GPUs with 80GB of memory

Software#