API Reference

Large Language Models (RC15)

The OpenAPI spec details the endpoints for NVIDIA NIM for LLMs:

  • /v1/health/ready - Health endpoint

  • /v1/models - Show available models

  • /v1/chat/completions - Chat Completions Endpoint

  • /v1/completions - Completions Endpoint

The /v1/completions and /v1/chat/completions endpoints can be found in the NIM OpenAPI Schema.

Previous Support Matrix
Next Observability
© Copyright © 2024, NVIDIA Corporation. Last updated on May 30, 2024.