Graph Execution Engine#

Graph Execution Engine is used to execute AI application graphs. It accepts multiple graph files as input, and all graphs are executed in same process context. It also needs manifest files as input which includes list of extensions to load. It must list all extensions required for the graph. Registry graph install command can be used to download all required extensions and generate manifest file.

/opt/nvidia/graph-composer/gxe --help
  Flags from gxf/gxe/gxe.cpp:
  -app (GXF app file to execute. Multiple files can be comma-separated)
    type: string default: ""
  -app_root (Root path for GXF app and subgraph files with relative path)
    type: string default: ""
  -graph_directory (Path to a directory for searching graph files.)
    type: string default: ""
  -log_file_path (Path to a file for logging.) type: string default: ""
  -manifest (GXF manifest file with extensions. Multiple files can be
    comma-separated) type: string default: ""
  -severity (Set log severity levels: 0=None, 1=Error, 2=Warning, 3=Info,
    4=Debug. Default: Info) type: int32 default: 3

Other options

1. How to override the parameters that are specified in the graph file using command line options?#

1. Single graph file#

Command line option --param of gxe can be used to override the parameters specified in the graph file. Complete path is delimited by / only exception being the last literal whose value has to be overridden is delimited by =

Below is the snippet of a graph file

---
name: Entity1
components:
- type: nvidia::gxf::PeriodicSchedulingTerm
  parameters:
    recess_period: 2000000
- type: nvidia::gxf::CountSchedulingTerm
  parameters:
    count: 100
- type: nvidia::gxf::test::StepCount
  parameters:
    expected_count: 100
---

To override the count of CountSchedulingTerm below command line option can be used.

--param=Entity1/nvidia::gxf::CountSchedulingTerm/count=101

2. Multiple subgraph files#

When multiple subgraph files are used, then the entity names of various subgraphs are delimited by . until the componet name is reached whose parameter has to be overriden. Hereafter the component type and the parameter will be delimited by /

Below is the snippet of multiple sub graph files

test_subgraph.yaml

---
name: gather_subgraph
components:
- type: nvidia::gxf::Subgraph
  name: gather_subgraph
  parameters:
    location: "gxf/test/apps/gather_subgraph.yaml"
    prerequisites:
      monitored_rx: rx/signal
- name: output
  parameters:
    max_capacity: 2
- name: forward1_buf_term
  parameters:
    min_size: 1
---

gather_subgraph.yaml

---
name: forward_subgraph_1
components:
- name: forward
  type: nvidia::gxf::Subgraph
  parameters:
    location: gxf/test/apps/forward_subgraph.yaml
    prerequisites:
      monitored_rx: prerequisites/monitored_rx
---

forward_subgraph.yaml

---
name: counter
components:
- name: step_counter
  type: nvidia::gxf::test::StepCount
  parameters:
    expected_count: 100
---

To override the expected_count of step_counter below command line option can be used.

--param=gather_subgraph.forward_subgraph_1.counter/nvidia::gxf::test::StepCount/expected_count=101