Large Language Models (1.0.0)
Large Language Models (1.0.0)

API Reference

The OpenAPI spec details the endpoints for NVIDIA NIM for LLMs:

  • /v1/health/ready - Health endpoint

  • /v1/models - Show available models

  • /v1/chat/completions - Chat Completions Endpoint

  • /v1/completions - Completions Endpoint

The /v1/completions and /v1/chat/completions endpoints can be found in the NIM OpenAPI Schema.

Previous Support Matrix
Next Utilities
© Copyright © 2024, NVIDIA Corporation. Last updated on Aug 21, 2024.