Release Notes#

Release 2.0.0#

Summary#

This major release introduces support for loading custom and fine-tuned checkpoints, enabling users to leverage their own model weights or community-provided variants. The internal implementation of NIM has migrated to the NVIDIA BioNeMo Framework, providing unified training and inference code bases and standardized checkpoint formats.

Thanks to the migration to the BioNeMo Framework, new Evo 2 NIM release delivers up to 30% faster inference workflows compared to the 1.x series.

Important: Due to the change in internal model representation, model layer names and parameter shapes have changed. As a result, /forward API calls are not backward-compatible with 1.x releases.

Model Variant#

  • Evo 2 40B 1M

Release 1.0.2#

Summary#

This is a minor update that includes changes that enhance stability for users operating in multi-GPU environments and improve compatibility with new NIM versions:

  • Resolved an issue related to FP8 extra states when running on specific combinations of GPU interconnects and CPUs. The fix ensures correct handling of FP8 extra states, with additional checks to verify correct functionality.

  • Updated nimlib and related dependencies to improve compatibility with the latest NIM releases.

Model Variant#

  • Evo 2 40B 1M

Release 1.0.1#

Summary#

This is a minor update that includes the following changes:

  • The input prompt is now automatically converted to uppercase internally, helping to prevent the common mistake of supplying lowercase DNA sequences to the model.

  • For non-recoverable errors, such as unrecoverable memory ECC errors, the health endpoint will now reflect the error status. This allows cloud infrastructure to redeploy the instance to healthy hardware.

Model Variant#

  • Evo 2 40B 1M

Release 1.0.0#

Summary#

This is the first release of Evo 2 NIM. Evo 2 is a biological foundation model that is able to integrate information over long genomic sequences, while retaining sensitivity to single-nucleotide changes.

This release features 40 billion parameters model trained on 11 trillion DNA nucleotides with context-length of up to 1 million DNA nucleotides.

Model Variant#

  • Evo 2 40B 1M

Notes and Limitations#

Ensure you use this model with GPUs that have FP8 support, such as NVIDIA H100, NVIDIA H200, or newer. For more information, see Prerequisites and Support Matrix for Evo2 NIM. Older GPUs are not currently supported.

Ensure you always use the benchmarking suite so that the deployed model works as expected.