About Platform Setup#
This section describes how to set up NeMo Microservices on your Kubernetes cluster using the NeMo Microservices Helm Chart. With this chart, you can deploy NeMo Microservices as a full deployment or a subset of the APIs as you need.
This Platform Setup chapter is for the following personas.
Cloud administrators: Manage Kubernetes clusters and compute/storage resources. Deploy NeMo Microservices to the Kubernetes clusters on premises or cloud.
NeMo Microservices Helm Chart#
The NeMo Microservices Helm Chart is an all-in-one Helm chart that bundles the complete NeMo Microservices ecosystem and all required dependencies for full platform deployment.
You can also customize the configuration of your installation by updating the values.yaml file. You can also use the pre-configured tags to install only specific microservices that you need.
For the chart assets and additional details, refer to the NeMo Microservices Collection page in the NVIDIA NGC Catalog.
Deploy NeMo Microservices with Helm#
The following sections provide detailed instructions on how to deploy NeMo Microservices using the NeMo Microservices Helm Chart.
Install NeMo Microservices using the chart on your Kubernetes cluster.
Other Configurations#
Review and manage other cluster settings.
Review and configure how NeMo Microservices use Open Telemetry for observability.
Review and configure how NeMo Microservices use Milvus for vector database storage.