Experiment Configuration#

Field

value_type

description

default_value

valid_min

valid_max

valid_options

automl_enabled

model_name

string

Backend name that model_agnostic reads from the specification to select Sparse4D; the shipped specifications set it to sparse4d.

sparse4d

results_dir

string

Parent directory for the output of an action; TAO Deploy writes to its gen_trt_engine or trt_inference subdirectory unless the action block sets its own results_dir; set at least one of the two.

model

collection

Model dimensions that both actions share. Refer to Model Configuration.

FALSE

plugin

collection

Plugin library that both actions load. Refer to Plugin Configuration.

FALSE

gen_trt_engine

collection

Settings for the gen_trt_engine action. Refer to TensorRT Engine Generation Configuration.

FALSE

inference

collection

Settings for the inference action. Refer to Inference Configuration.

FALSE

Model Configuration#

Field

value_type

description

default_value

valid_min

valid_max

valid_options

automl_enabled

num_cameras

int

Number of cameras in each frame; the engine profile fixes this value, so use the same value for gen_trt_engine and inference.

6

1

input_height

int

Height of each camera image in pixels; the image_wh array of every prepared frame must equal [input_width, input_height].

256

1

input_width

int

Width of each camera image in pixels; together with input_height, it sets the shape of the img input.

448

1

num_queries

int

Number of object queries in the exported model; gen_trt_engine accepts only the default value.

900

1

num_temp_instances

int

Number of queries that TAO Deploy caches from one frame to the next; the value cannot exceed num_queries, and gen_trt_engine accepts only the default value.

600

1

embed_dims

int

Channel width of each query feature; gen_trt_engine accepts only the default value.

256

1

anchor_dims

ordered_int

Number of components in each anchor box, including the 3D velocity; TAO Deploy supports only 11.

11

11

num_classes

int

Number of classes in the classification1 and classification2 outputs; inference rejects outputs of any other width.

7

1

Plugin Configuration#

Field

value_type

description

default_value

valid_min

valid_max

valid_options

automl_enabled

path

string

Absolute path to a trusted plugin library.

sha256

string

Required SHA-256 hash of the file at plugin.path.

TensorRT Engine Generation Configuration#

Field

value_type

description

default_value

valid_min

valid_max

valid_options

automl_enabled

results_dir

string

Directory that receives status.json and experiment.yaml for this action; if empty, TAO Deploy uses the gen_trt_engine subdirectory of the top-level results_dir; the engine goes to save_engine, not to this directory.

gpu_id

int

Index of the GPU that builds the engine; TAO Deploy exports it as CUDA_VISIBLE_DEVICES.

0

0

onnx_file

string

Path to the ONNX file that the Sparse4D export action writes; the build rejects a file whose input names, output names, or number of nv::MSDA operators differ from that export.

save_engine

string

Path of the new engine file; TAO Deploy also writes the sidecar file <save_engine>.json, and the build stops if either file already exists.

data_type

categorical

Precision of the engine; the build disables TensorFloat-32 (TF32) for both values, and fp16 also sets the TensorRT FP16 flag; the build rejects any other value, including 8-bit integer (INT8).

fp32

fp32,fp16

workspace_size

float

Workspace memory pool limit for the build in gibibytes (GiB); the value must be finite and greater than zero.

4.0

0.1

Inference Configuration#

Field

value_type

description

default_value

valid_min

valid_max

valid_options

automl_enabled

results_dir

string

Directory that receives the output files; if empty, TAO Deploy uses the trt_inference subdirectory of the top-level results_dir; the action stops if predictions.jsonl, summary.json, or raw already exists there.

num_gpus

ordered_int

Number of GPUs; the launcher always runs inference on one GPU.

1

1

gpu_ids

list

Indices of the GPUs that the launcher exposes as CUDA_VISIBLE_DEVICES; if you list more than one, the launcher keeps only the highest index.

[0]

FALSE

trt_engine

string

Path to the engine that gen_trt_engine built; the sidecar file <trt_engine>.json must sit beside it.

manifest

string

Path to the JSON manifest of prepared NPZ frames.

num_output

int

Number of queries per frame that TAO Deploy decodes, taken in descending order of class probability; the value must be greater than zero and at most num_queries.

300

1

score_threshold

float

Minimum raw class probability for a detection; the comparison uses the probability before quality weighting, and the value must be from 0 to 1.

0.05

0.0

1.0

tracking_threshold

float

Minimum raw class probability at which a query that has no instance ID receives a new one; the value must be from 0 to 1.

0.2

0.0

1.0

confidence_decay

float

Multiplier for the confidence that a cached query had in the previous frame; the larger of the decayed value and the current confidence ranks the query for the next cache; the value must be from 0 to 1.

0.8

0.0

1.0

max_time_interval

float

Largest time gap in seconds between consecutive frames of one scene that keeps the cache; a larger gap resets the temporal state; the value must be finite and greater than zero.

2.0

0.0

save_raw

bool

Whether to write the raw engine outputs of every frame to the raw directory under results_dir.

False