Skip to navigation
About

Ecosystem Overview

View as Markdown

The NIM Metadata API helps developers and automated tooling select profiles within the NVIDIA NIM ecosystem before downloading containers. For API capabilities, refer to Overview; for the publication and request flow, refer to Architecture Overview.

Understanding the NVIDIA NIM Ecosystem

NVIDIA NIM microservices package models with inference backends and deployable profiles. The NGC Catalog identifies available containers and tags, while metadata and repository APIs expose information used to evaluate them.

The NIM Metadata API’s role is to return tag-level profiles, hardware requirements, release details, and capabilities when those values were recorded at publish time. It complements container-level catalog information and the deployment documentation for each microservice.

Choosing an Information Source

Choose the information source that matches your question:

SourceUse WhenInformation Provided
NGC Catalog and registry searchDiscover a NIM microservice and identify its repository and tags.Container identity and catalog discovery, including GPU filters.
NIM Metadata APICompare profiles for a specific microservice and tag before deployment.Tag-level hardware requirements, precision, backend, parallelism, and capabilities, when populated.
NGC repository endpointsRetrieve information about a microservice as a whole.Repository-level fields such as name, nim_type, supported_models, and sdk_example_url.
NGC GPU metadata endpointDisplay a GPU name for a PCI device identifier.Recorded subsystem variants and their displayName values.
Microservice documentation and support matrixDeploy the selected profile or investigate incomplete metadata coverage.Microservice-specific deployment instructions and supported hardware.

The metadata API and repository endpoints answer different questions. Make both calls when you need tag-level profiles and container-level details. For endpoint forms and authentication considerations, refer to Related Endpoints and Registry Search.

How the Information Sources Work Together

Use the sources in the following order when planning a deployment:

  1. Identify the NIM microservice and container tag in the NGC Catalog.
  2. Query the NIM Metadata API for that repository and tag.
  3. Compare available profiles against hardware and workload requirements.
  4. Retrieve repository information or GPU display names when needed.
  5. Follow the microservice’s deployment instructions with the selected profile_id.

Metadata access and container entitlement are separate. Reading metadata does not grant access to pull the container. If metadata is unavailable, consult the microservice’s documentation rather than assuming that the container is unavailable or unsupported.

Next Steps

Continue with the resource that matches your goal:

Make Your First Request

Query a microservice and read the metadata response.

Select a Profile

Apply hardware constraints and record a profile identifier.

Query Complementary Endpoints

Retrieve container information and resolve GPU identifiers.

Handle Missing Metadata

Diagnose status codes and unrecorded requirements.