Application Examples#
NVIDIA NIM#
NVIDIA Inference Microservices (NIM) are available at the NVIDIA NGC catalogue and are available in an interactive experience at build.nvidia.com.
NVIDIA provides instructions on how to use Helm to deploy these containers on Kubernetes.
NVIDIA Cloud Functions (NVCF)#
NVIDIA Cloud Functions is a serverless API that allows users to deploy and manage AI workloads on GPUs, providing scalability, security, and reliability, accessible via HTTP polling, streaming, or gRPC protocols. Kubernetes integration can be achieved with the NVIDIA Cluster Agent (NVCA) which makes compute from the cluster available for NVCF function deployments.
NVIDIA provides instruction on how to use NVCF at https://docs.nvidia.com/cloud-functions/user-guide/latest/cloud-function/overview.html