Logging into TensorRT-Cloud

Important

Logging in is only needed for on-demand engine build through TensorRT-Cloud. Pre-built engine download does not require logging in; skip to Downloading a Pre-built TensorRT Engine.

Prerequisites

  1. Ensure you have access to TensorRT-Cloud.

  2. Enable Early Access Features in the TensorRT-Cloud CLI.

Steps

  1. Go to the https://nvcf.ngc.nvidia.com/functions.

  2. Select Shared Functions. You should see a list of functions whose names begin with trtc_builder.

    Shared Functions

  3. Click Generate Run Key.

    Generate Run Key Generate New Run Key

  4. Click Confirm and copy the generated key. It should begin with nvapi.

  5. Log into the TensorRT-Cloud CLI.

    trt-cloud login --nvapi-key <GENERATED_TOKEN>

Note

  • You will need to rotate your run key at the frequency required by NvCF/NGC. Currently, the frequency is every 30 days.

  • Your API key is stored as plain text on your machine.