Software#

Software is a critical component of the Enterprise Reference Architecture, providing the foundation for deploying, managing, and orchestrating AI workloads at scale. In conjunction with the NVIDIA RTX PRO AI Factory, the NVIDIA Enterprise AI Factory Validated Design (for enterprise and government) utilizes software tools and solutions from NVIDIA to provide a comprehensive, high-performance solution for modern AI projects and ensure optimal performance while adhering to best practices. Additionally, it includes tested and validated solutions from an ecosystem of partners, with specified versions and integrations, to support the end-to-end AI pipeline, from data curation to model testing, workflow orchestration, guard railing, security, and more.

Key components of these software designs include:

  • NVIDIA AI Enterprise, a suite of software tools, libraries and frameworks, including NVIDIA NIM and NeMo microservices, that accelerate and simplify the development, deployment, and scaling of AI applications. Also includes Base Command Manager, which streamlines infrastructure provisioning, workload management and resource monitoring.

  • NVIDIA Omniverse™, a platform of APIs, SDKs and services that enable developers to integrate OpenUSD, NVIDIA RTXTM rendering technologies and generative physical AI into existing software and simulation tools for industrial and robotic use cases

  • NVIDIA Run:ai, an orchestration platform that accelerates AI operations with dynamic orchestration across the AI lifecycle

  • NVIDIA vGPU software, which creates virtual GPUs that can be shared across multiple virtual machines, scaling GPU utilization and enhancing ROI while centralizing manageability and security for IT

  • NVIDIA NetQ, a highly scalable, modern network operations toolset that provides visibility, troubleshooting and validation of Cumulus fabrics in real time