Release Notes#
This page lists changes, fixes, and known issues for each NIM LLM early access (EA) release.
Updates#
The following VLM NIMs are now available:
The following LLM NIMs are now available:
Dynamo recipes are now available on GitHub for the following NIMs:
Known Issues#
This release includes the following known issues and limitations:
-
This turbo NIM is tuned for high throughput per GPU at a concurrency of 256.
The B200 profile supports the NVFP4 precision only. INT4 is not supported.
The
NIM_MANIFEST_ALLOW_UNSAFEenvironment variable is not supported.The
/v1/responseendpoint is not available in this NIM.On the
/v1/completionsendpoint, thestructured_outputs.choicefield does not strictly enforce constrained outputs.
-
This turbo NIM is tuned for high throughput per GPU at a concurrency of 256.
To use this NIM at concurrency <= 64, you should use MTP by setting
NIM_NUM_SPECULATIVE_TOKENS=2. To use this NIM at concurrency > 64, do not use MTP for optimal performance.
-
This turbo NIM provides workload-specific profiles for RAG (ISL 2,400, OSL 1,000, SSP 5,600) and agentic (ISL 6,400, OSL 400, SSP 57,600) workloads on B200 and H200 GPUs.