Advanced Topics# This section covers advanced TensorRT features and configuration options. Version Compatibility Manually Loading the Runtime Loading from Storage Using Version Compatibility with the ONNX Parser NVIDIA Ampere GPU Architecture (and Later) Compatibility Level Same Compute Capability Compatibility Level Refitting an Engine Weight-Stripping Refitting a Weight-Stripped Engine Directly from ONNX Weight-Stripping Work with Lean Runtime Fine-Grained Refit Build Stripping Weights with Fine-Grained Refit Build Algorithm Selection and Reproducible Builds Strongly Typed Networks Reduced Precision in Weakly-Typed Networks Control of Computational Precision I/O Formats Sparsity Empty Tensors Reusing Input Buffers Engine Inspector Optimizer Callbacks Preview Features Debug Tensors Weight Streaming Cross-Platform Compatibility Tiling Optimization Multi-Device Inference (Preview Feature)
