Skip to navigation

Release 1.0.2

Summary

This is a minor update that includes changes that enhance stability for users operating in multi-GPU environments and improve compatibility with new NIM versions:

  • Resolved an issue related to FP8 extra states when running on specific combinations of GPU interconnects and CPUs. The fix ensures correct handling of FP8 extra states, with additional checks to verify correct functionality.

  • Updated nimlib and related dependencies to improve compatibility with the latest NIM releases.

Model Variant

  • Evo 2 40B 1M