NVIDIA In-Game Inferencing (NVIGI) Developer Pack 1.6.0 Release

Getting Started

• Introduction
  • What is NVIGI?
  • The Current Release of the Developer Pack
• First Steps
  • Abstract
  • Recommended First Steps
  • Next Steps
• Release Notes
  • 1.6.0 Release
  • 1.5.0 Release
  • 1.4.0 Release
  • 1.3.0 Release
  • 1.2.0 Release
  • 1.1.1 Release

The Basics

• Top-Level Items
  • Models (A.K.A. Model Data)
  • Important Documentation in the Developer Pack
  • Contents of the Developer Pack
• NVIGI - Programming Guide
  • Table of Contents
  • INTRODUCTION
  • Key Concepts
  • Typed And Versioned Structures
  • Thread Safety
  • Security
  • Core API
  • Validation
  • D3D Considerations
  • 3rd Party Dependencies
  • Troubleshooting
• NVIDIA In-Game Inference AI Plugins
  • Abstract
  • Introduction
  • Prerequisites
  • Directory Setup
  • Basic Steps: Summary
  • Basic Steps: Detailed Breakdown
  • Programming Guides
  • Sample App and Source
  • Release Notes:

Core APIs

• NVIGI - Programming Guide For Local And Cloud Inference
• NVIGI Integration Tutorial
• Architecture
• GPU Scheduling for AI
• Running on Multiple GPU Systems
• HYBRID AI
• nvigi.plugin.net Security Guide
• llama.cpp patch for enabling CIG without using IGI

Samples

• The 3D Sample
• The Command-Line Basic Sample
• The C++ Basic ASR Sample
• The C++ Basic GPT Sample
• The C++ Basic TTS Sample
• The Command-Line Function Calling Sample
• The Command-Line Pipeline Sample
• The Command-Line RAG Sample
• The Command-Line Reload Sample
• Code Agent Sample: Lua Dungeon Crawler

Plugins

• Automatic Speech Recognition (ASR) - Whisper Programming Guide
• Generative Pre-Trained Transformers (GPT) Programming Guide
• Embedding (EMBED) Programming Guide
• TTS Riva Magpie Flow (ASqFlow) Programming Guide
• Plugin Development Guide
• Plugin Development Tutorial

Full Source Code

• NVIGI Public Source GitHub Pull-and-Build Scripts

Legal Notices

• 3rd PARTY SOFTWARE