Prerequisites
System Requirements
For detailed hardware requirements, supported GPU configurations, TensorRT optimization details, and system setup instructions (Docker, NVIDIA Drivers, Container Toolkit), refer to the Support Matrix.
NGC (NVIDIA GPU Cloud) Account
- Create an account on NGC
- Generate an API Key
- Log in to Docker with your NGC API key (enter the key as the password when prompted).
Client Software
The Quickstart Guide examples use the following tools:
- Python 3 with the
requestspackage, for the Python client example. Install the package withpip install requests. curl, for the health check and the Shell client example.