Cloud Service Provider (CSP) Deployment#
NIM LLM and VLM supports deployment to major cloud service providers. Select your CSP below for provider-specific setup instructions, including GPU instance selection, container configuration, and integration with managed services.
Deployment Options#
Use one of the following guides to deploy NVIDIA NIM for Large Language Models (LLM) and Vision Language Models (VLM) on a cloud service provider:
Google Cloud
Deploy on Google Cloud by using either GKE or Vertex AI.
AWS
Deploy on AWS by using either Amazon EKS or SageMaker.
Azure
Deploy on Azure by using either AKS or AI Foundry.
Oracle
Deploy on Oracle Cloud Infrastructure by using Oracle Kubernetes Engine.