Is this page helpful?

Prerequisites#

This documentation describes the prerequisites for the Semantic Split C-RADIO NIM.

Hardware Support#

GPU

GPU Memory (GB)

# of GPUs

L40S

48 GB

1

L20

48 GB

1

The Early Access release is specifically fine-tuned for L40S and L20. In particular, NVEnc enabled hardware is required. Please contact us for inquiries on how the NIM could be extended to support more hardware configurations.

Software#

  • sudo privileges are required on nim host machine to mount local directories.

  • With a Docker-supported operating system, install Docker - minimum version: 23.0.1

  • Install NVIDIA Drivers - minimum version: 535. You can use the NVIDIA driver release 535.86 (or later R535), or 545.23 (or later R545) which are supported on L40S DataCenter GPUs.

  • Install and configure the NVIDIA Container Toolkit - minimum version: 1.13.5

  • Verify your container runtime supports NVIDIA GPUs by running the following:

    docker run --rm --runtime=nvidia --gpus all ubuntu nvidia-smi

For more information on enumerating multi-GPU systems, please see the NVIDIA Container Toolkit’s GPU Enumeration Docs.

NGC#

You must have an authenticated NGC (NVIDIA GPU Cloud) account with access to both the respective NIM and the model checkpoints. Use the following procedure to log in to NGC, and set the NGC_API_KEY environment variable, so that you can pull images.

  • Create an account on NGC.

  • Generate an API Key. The following steps require your NGC API key.

  • Authenticate local Docker with NGC by running the following code. For more details, see the NGC authentication documentation.

    docker login nvcr.io
Username: $oauthtoken
Password: <NGC API key>

  • Set the NGC_API_KEY environment variable in your shell.

    export NGC_API_KEY=<NGC API key>

Supported Formats#

Specification

Supported types

Input codecs

H.264, HEVC, VP9, VP8, AV1

Input pixel formats

NV12/YUV420p

Input container types

MP4, MOV, WEBM

Maximum input resolution

1080p

Output codec and container

H.264, MP4

Output resolution

Same as input resolution

Supported Operation Modes#

The early access release supports the following operating modes.

Input Source

Results Destination

S3 environment variables required?

/data mount required?

/results mount required?

S3 bucket

Local file system

Yes

No

Yes

S3 bucket

S3 Bucket

Yes

No

No

Local file system

Local file system

No

Yes

Yes

Local file system

S3 Bucket

Yes

Yes

No

  • A mix of S3 and Local files in a single query is not currently supported.

  • All S3 files must located on the same S3 account.