Is this page helpful?

Release Notes for NVIDIA NeMo Retriever Embedding NIM#

This documentation contains the release notes for NVIDIA NeMo Retriever Embedding NIM.

Note

Some releases are labelled “Production Branch” or “(PB)”. Production Branches provide reliable, stable versions of the NIM. Non-production branch releases (sometimes called Feature Branch (FB) releases) contain the latest features, improvements, and optimizations.

Release 2.2.2#

This patch release includes the following updates:

  • Adds the com.nvidia.nim.model_download_protocol=native-v1 container label for NIM Operator deployment compatibility (requires NIM Operator >= 3.1.2).

  • The non-default RUST_LOG configuration is removed so that logging is controlled by the product default or explicit user configuration.

Release 2.2.1#

Release 2.2.1 was intentionally skipped.

Release 2.2#

This release adds the nvidia/nemotron-3-embed-1b NIM, a text embedding NIM for query and passage embeddings.

Highlights#

This release contains the following key changes:

  • Added support for nvidia/nemotron-3-embed-1b.

  • Added the NIM_PERFORMANCE_MODE environment variable for selecting latency-oriented or throughput-oriented defaults for unset batching and engine-count environment variables. For details, refer to Environment Variables for NVIDIA NeMo Retriever Embedding NIM.

Support Matrix Updates#

  • Added NVFP4 optimized pipelines for NVIDIA GB200 and NVIDIA RTX PRO 6000 Blackwell Server Edition.

  • Added support for BF16 pipelines on supported NVIDIA GPUs, including NVIDIA GB10.

For details, refer to Support Matrix for NVIDIA NeMo Retriever Embedding NIM.

Compatibility Updates#

  • nvidia/nemotron-3-embed-1b supports text inputs with the /v1/embeddings endpoint.

  • The validated maximum sequence length is 4096 tokens.

  • The model returns native 2048-dimensional embeddings when embedding_type is float. For supported compressed embedding types, refer to Support Matrix for NVIDIA NeMo Retriever Embedding NIM.

  • Dynamic embedding dimensions and image inputs are not supported for this model.

All Known Issues#

The known issues for NeMo Retriever Embedding NIM are the following:

  • The container health check used by Docker and Docker Compose can report the container as unhealthy even when the NIM is ready. This can block Compose dependencies that require service_healthy.

    Workaround: Override the health check in Docker Compose:

    healthcheck:
  test: ["CMD", "/usr/bin/curl", "-fsS", "http://127.0.0.1:8000/v1/health/ready"]

  • For nvidia/nemotron-3-embed-1b, setting NIM_SERVER_MAX_QUEUE_SIZE=0 can cause the NIM to log an error during padded-batcher startup instead of rejecting the invalid configuration. Use the default value, 1024, or set NIM_SERVER_MAX_QUEUE_SIZE to a positive integer.

Release Notes for Previous Versions#