Is this page helpful?

Release Notes#

Release 2.0.8-variant#

This release contains model updates outlined in the following sections.

Inkling#

This is the initial release of Inkling. This NIM is part of the NIM offering. This NIM serves the model with an SGLang backend. For more information on this model, see the model card.

For GPU support, refer to the support matrix for Inkling.

Note the following limitations:

  • Inkling

    • The first inference request incurs a cold-start latency of approximately 5–10 minutes while flashinfer JIT-compiles kernels. Subsequent requests are fast.

    • LoRA adapters are not supported.

    • FFmpeg is intentionally removed from the base image for licensing compliance. As a result, torchcodec-dependent processors (for example, mimo_v2 and qwen_omni) fail to load at startup with libtorchcodec errors. These errors are cosmetic and do not affect Inkling.

For information about past updates and older versions, refer to the previous release notes.