Create Endpoints from Container Image

This guide shows how to create a dedicated endpoint from a Docker image.

Create Endpoint

1. Go to the Endpoints page and click Create Endpoint.
2. Select Create Endpoint.
3. Select Create from Container Image.
4. For Endpoint name, enter container-image-endpoint or any name you prefer.
5. For Image configuration, select the image, command, and port:
   • Image: Choose the image to use. For example: nvcr.io/nvidia/pytorch:24.11-py3.
   • Server Port: Choose the port your process listens on. For example: 8080.
   • Run command: Choose the command to run. For example: python -m http.server 8080.
   • Private image registry auth (optional): If you use a private registry, add registry credentials on the Registries page.
6. Leave other configurations at their defaults, or refer to endpoint configurations for details.

View Endpoint

Once created, the endpoint appears on the Endpoints page. View logs for each replica by clicking the Logs button in the Replica section.