Software

Infrastructure software is a critical component of the NVIDIA Enterprise Reference Architecture, providing the foundation for deploying, managing, and orchestrating AI workloads at scale. In conjunction with the NVIDIA HGX AI Factory, the NVIDIA Enterprise AI Factory Validated Design (for enterprise and government) utilizes software tools and solutions from NVIDIA to provide a comprehensive, high-performance solution for modern AI projects and ensure optimal performance while adhering to best practices. Additionally, it includes tested and validated solutions from an ecosystem of partners, with specified versions and integrations, to support the end-to-end AI pipeline, from data curation to model testing, workflow orchestration, guard railing, security, and more.

Key components of these software designs include:

• NVIDIA AI Enterprise, a suite of software tools, libraries and frameworks, including NVIDIA NIM and NeMo microservices, that accelerate and simplify the development, deployment, and scaling of AI applications. Also includes Base Command Manager, which streamlines infrastructure provisioning, workload management and resource monitoring.

• NVIDIA Run:ai, an orchestration platform that accelerates AI operations with dynamic orchestration across the AI lifecycle

• NVIDIA NetQ, a highly scalable, modern network operations toolset that provides visibility, troubleshooting and validation of Cumulus fabrics in real time