Support Matrix#

Models#

Model Name

Model ID

Publisher

FLUX.1-dev

black-forest-labs/flux.1-dev

Black Forest Labs

Supported Hardware#

Black Forest Labs / FLUX.1-dev#

System Requirements

GPU Memory

RAM

OS

CPU

Minimal

16GB

40GB

Linux/WSL2

x86_64

Recommended

32GB

64GB

Linux/WSL2

x86_64

NVIDIA supports the FLUX.1-dev model on the following GPU models with the optimized TensorRT engine.

GPU

GPU Memory (GB)

Precision

GeForce RTX 5090

32

FP4, FP8

GeForce RTX 5080

16

FP4, FP8

GeForce RTX 4090

24

FP8

GeForce RTX 4090 Laptop

16

FP8

GeForce RTX 4080

16

FP8

NVIDIA RTX 6000 Ada Generation

48

FP8

Software#

NVIDIA Driver#

NVIDIA NIM for Visual Generative AI is built on top of Triton Inference Server (25.01) which requires NVIDIA Driver release 560 or later.

Refer to the Release Notes for the detailed list of supported drivers.

NVIDIA Container Toolkit#

Your Docker environment must support NVIDIA GPUs. Refer to Installing the NVIDIA Container Toolkit for more information.