Common Component Combinations

View as Markdown

These are typical adoption patterns showing how components complement each other:

Use CaseCore ComponentsOptional Additions
Basic ML InferenceTensorRT + TritonDALI, GPU Operator
Speech/NLP PipelineRiva SDK + TritonDALI, TensorRT
Single-Node LLMTensorRT-LLM + DynamoModel Optimizer
Distributed LLMDynamo + KV Block Manager + NIXL + Router + TensorRT-LLMPlanner, Model Express, Model Optimizer
Kubernetes DeploymentGPU Operator + KAI SchedulerNetwork Operator, Grove
Full GenAI StackDynamo + NIXL + KV Block Manager + Router + Grove + KAI Scheduler + PlannerAIConfigurator, AIPerf

Architecture Overview

NVIDIA Inference Architecture Overview