> This page is for version 0.1.0.
> For other versions, use one of these documentation indexes:
> - 0.2.0 (Latest) (default): https://docs.nvidia.com/nim/computer-vision/semantic-split/0.2.0/llms.txt
> - 0.1.0: https://docs.nvidia.com/nim/computer-vision/semantic-split/0.1.0/llms.txt

> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/nim/computer-vision/semantic-split/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/nim/computer-vision/semantic-split/_mcp/server.

# Configure The NIM at Runtime

## GPU Selection

You can use the `--gpus all` argument to `docker run` in homogeneous environments with one or more of the same GPU. In heterogeneous environments with a combination of GPUs, such as L40S and a GeForce display GPU, you should only run workloads on L40S GPUs. Use the following option to identify specific GPUs:

- The environment variable `CUDA_VISIBLE_DEVICES`. For example: `-e CUDA_VISIBLE_DEVICES=1`.

Use the `nvidia-smi -L` command to get the device ID(s) to use as input(s). This command should return information similar to the following:

```bash
GPU 0: NVIDIA GeForce RTX 3080

GPU 1: L40S
```

For more information, see [NVIDIA Container Toolkit documentation](https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/docker-specialized.html#gpu-enumeration).

## Environment Variables

You can pass the following environment variables into a NIM by adding the `-e` flag to the docker run command.

| ENV                        | Required? | Default | Notes                                                                                              |
| -------------------------- | --------- | ------- | -------------------------------------------------------------------------------------------------- |
| NGC_API_KEY              | Yes       | None    | Your NGC API key with read access to the model registry for the model profile you are using.       |
| NIM_LOG_LEVEL            | Optional  | None    | You can pass `DEBUG` value to enable extra logging.                                                |
| NIM_T RITON_LOG_VERBOSE | Optional  | None    | You can pass verbosity level \[1,2,3,4,5\] to enable extra logging from the triton server backend. |