Triton Management Service Deployment Guide (1.0.0)

Triton Management Service is an application that helps users manage and orchestrate a fleet of Triton Inference Servers in a Kubernetes Cluster.

Contents

Getting Started

• TMS Minkube Quickstart Guide
• Triton Management Service Deployment Guide

Key Concepts

• Model Repositories
• Image Allowlist
• Leases
• Autoscaling Leases
• Triton Pools & Quota Base Shared Tritons
• TMS Metrics
• TMS GRPC API Package

Reference

• Triton Management Service Control
• Helm Chart Values

Release Notes

• Release Notes for Triton Management Service