holoscan.operators

This module provides a Python API to underlying C++ API Operators.

class holoscan.operators.AJASourceOp

Bases: holoscan.gxf._gxf.GXFOperator

Operator to get a video stream from an AJA capture card.

Attributes

args	The list of arguments associated with the component.
conditions	Conditions associated with the operator.
fragment	The fragment that the operator belongs to.
gxf_cid	The GXF component ID.
gxf_context	The GXF context of the component.
gxf_eid	The GXF entity ID.
gxf_typename	The GXF type name of the resource.
id	The identifier of the component.
name	The name of the operator.
operator_type	The operator type.
resources	Resources associated with the operator.

spec

Methods

OperatorType	Members:
add_arg(*args, **kwargs)	Overloaded function.
compute(self, arg0, arg1, arg2)	Operator compute method.
initialize(self)	Initialize the operator.
setup(self, spec)	Define the operator specification.
start(self)	Operator start method.
stop(self)	Operator stop method.

class OperatorType

Bases: pybind11_builtins.pybind11_object

Members:

NATIVE

GXF

Attributes

name

value

GXF =

NATIVE =

__init__(self: holoscan.core._core.Operator.OperatorType, value: int) → None

property name

property value

__init__(self: holoscan.operators._operators.AJASourceOp, fragment: holoscan.core._core.Fragment, device: str = '0', channel: holoscan.operators._operators.NTV2Channel = <NTV2Channel.NTV2_CHANNEL1: 0>, width: int = 1920, height: int = 1080, framerate: int = 60, rdma: bool = False, enable_overlay: bool = False, overlay_channel: holoscan.operators._operators.NTV2Channel = <NTV2Channel.NTV2_CHANNEL2: 1>, overlay_rdma: bool = True, name: str = 'aja_source') → None

Operator to get a video stream from an AJA capture card.

Parameters

fragmentFragment

The fragment that the operator belongs to.

devicestr, optional

The device to target (e.g. “0” for device 0)

channelholoscan.operators.NTV2Channel or int, optional

The camera NTV2Channel to use for output.

widthint, optional

Width of the video stream.

heightint, optional

Height of the video stream.

framerateint, optional

Frame rate of the video stream.

rdmabool, optional

Boolean indicating whether RDMA is enabled.

enable_overlaybool, optional

Boolean indicating whether a separate overlay channel is enabled.

overlay_channelholoscan.operators.NTV2Channel or int, optional

The camera NTV2Channel to use for overlay output.

overlay_rdmabool, optional

Boolean indicating whether RDMA is enabled for the overlay.

namestr, optional

The name of the operator.

add_arg(*args, **kwargs)

Overloaded function.

1. add_arg(self: holoscan.core._core.Component, arg: holoscan.core._core.Arg) -> None

Add an argument to the component.

2. add_arg(self: holoscan.core._core.Component, arg: holoscan.core._core.ArgList) -> None

Add a list of arguments to the component.

property args

The list of arguments associated with the component.

Returns

arglistholoscan.core.ArgList

compute(self: holoscan.core._core.Operator, arg0: holoscan.core._core.InputContext, arg1: holoscan.core._core.OutputContext, arg2: holoscan.core._core.ExecutionContext) → None

Operator compute method. This method defines the primary computation to be executed by the operator.

property conditions

Conditions associated with the operator.

property fragment

The fragment that the operator belongs to.

Returns

nameholoscan.core.Fragment

property gxf_cid

The GXF component ID.

property gxf_context

The GXF context of the component.

property gxf_eid

The GXF entity ID.

property gxf_typename

The GXF type name of the resource.

Returns

str

The GXF type name of the resource

property id

The identifier of the component.

The identifier is initially set to -1, and will become a valid value when the component is initialized.

With the default executor (holoscan.gxf.GXFExecutor), the identifier is set to the GXF component ID.

Returns

idint

initialize(self: holoscan.operators._operators.AJASourceOp) → None

Initialize the operator.

This method is called only once when the operator is created for the first time, and uses a light-weight initialization.

property name

The name of the operator.

Returns

namestr

property operator_type

The operator type.

holoscan.core.Operator.OperatorType enum representing the type of the operator. The two types currently implemented are native and GXF.

property resources

Resources associated with the operator.

setup(self: holoscan.operators._operators.AJASourceOp, spec: holoscan.core._core.OperatorSpec) → None

Define the operator specification.

Parameters

specholoscan.core.OperatorSpec

The operator specification.

property spec

start(self: holoscan.core._core.Operator) → None

Operator start method.

stop(self: holoscan.core._core.Operator) → None

Operator stop method.

class holoscan.operators.BayerDemosaicOp

Bases: holoscan.gxf._gxf.GXFOperator

Format conversion operator.

Attributes

args	The list of arguments associated with the component.
conditions	Conditions associated with the operator.
fragment	The fragment that the operator belongs to.
gxf_cid	The GXF component ID.
gxf_context	The GXF context of the component.
gxf_eid	The GXF entity ID.
gxf_typename	The GXF type name of the resource.
id	The identifier of the component.
name	The name of the operator.
operator_type	The operator type.
resources	Resources associated with the operator.

spec

Methods

OperatorType	Members:
add_arg(*args, **kwargs)	Overloaded function.
compute(self, arg0, arg1, arg2)	Operator compute method.
initialize(self)	Initialize the operator.
setup(self, spec)	Define the operator specification.
start(self)	Operator start method.
stop(self)	Operator stop method.

class OperatorType

Bases: pybind11_builtins.pybind11_object

Members:

NATIVE

GXF

Attributes

name

value

GXF =

NATIVE =

__init__(self: holoscan.core._core.Operator.OperatorType, value: int) → None

property name

property value

__init__(*args, **kwargs)

Overloaded function.

1. __init__(self: holoscan.operators._operators.BayerDemosaicOp) -> None

Format conversion operator.

2. __init__(self: holoscan.operators._operators.BayerDemosaicOp, fragment: holoscan.core._core.Fragment, pool: holoscan.resources._resources.Allocator, cuda_stream_pool: holoscan.resources._resources.CudaStreamPool, in_tensor_name: str = ‘’, out_tensor_name: str = ‘’, interpolation_mode: int = 0, bayer_grid_pos: int = 2, generate_alpha: bool = False, alpha_value: int = 255, name: str = ‘format_converter’) -> None

Format conversion operator.

Parameters

fragmentFragment

The fragment that the operator belongs to.

poolholoscan.resources.Allocator

Memory pool allocator used by the operator.

cuda_stream_poolholoscan.resources.CudaStreamPool

CUDA Stream pool to create CUDA streams

in_tensor_namestr, optional

The name of the input tensor.

out_tensor_namestr, optional

The name of the output tensor.

interpolation_modeint, optional

The interpolation model to be used for demosaicing. Values available at: https://docs.nvidia.com/cuda/npp/group__typedefs__npp.html#ga2b58ebd329141d560aa4367f1708f191

bayer_grid_posint, optional

The Bayer grid position (default of 2 = GBRG). Values available at: https://docs.nvidia.com/cuda/npp/group__typedefs__npp.html#ga5597309d6766fb2dffe155990d915ecb

generate_alphabool, optional

Generate alpha channel.

alpha_valueint, optional

Alpha value to be generated if generate_alpha is set to True.

namestr, optional

The name of the operator.

add_arg(*args, **kwargs)

Overloaded function.

1. add_arg(self: holoscan.core._core.Component, arg: holoscan.core._core.Arg) -> None

Add an argument to the component.

2. add_arg(self: holoscan.core._core.Component, arg: holoscan.core._core.ArgList) -> None

Add a list of arguments to the component.

property args

The list of arguments associated with the component.

Returns

arglistholoscan.core.ArgList

compute(self: holoscan.core._core.Operator, arg0: holoscan.core._core.InputContext, arg1: holoscan.core._core.OutputContext, arg2: holoscan.core._core.ExecutionContext) → None

Operator compute method. This method defines the primary computation to be executed by the operator.

property conditions

Conditions associated with the operator.

property fragment

The fragment that the operator belongs to.

Returns

nameholoscan.core.Fragment

property gxf_cid

The GXF component ID.

property gxf_context

The GXF context of the component.

property gxf_eid

The GXF entity ID.

property gxf_typename

The GXF type name of the resource.

Returns

str

The GXF type name of the resource

property id

The identifier of the component.

The identifier is initially set to -1, and will become a valid value when the component is initialized.

With the default executor (holoscan.gxf.GXFExecutor), the identifier is set to the GXF component ID.

Returns

idint

initialize(self: holoscan.operators._operators.BayerDemosaicOp) → None

Initialize the operator.

This method is called only once when the operator is created for the first time, and uses a light-weight initialization.

property name

The name of the operator.

Returns

namestr

property operator_type

The operator type.

holoscan.core.Operator.OperatorType enum representing the type of the operator. The two types currently implemented are native and GXF.

property resources

Resources associated with the operator.

setup(self: holoscan.operators._operators.BayerDemosaicOp, spec: holoscan.core._core.OperatorSpec) → None

Define the operator specification.

Parameters

specholoscan.core.OperatorSpec

The operator specification.

property spec

start(self: holoscan.core._core.Operator) → None

Operator start method.

stop(self: holoscan.core._core.Operator) → None

Operator stop method.

class holoscan.operators.FormatConverterOp

Bases: holoscan.gxf._gxf.GXFOperator

Format conversion operator.

Attributes

args	The list of arguments associated with the component.
conditions	Conditions associated with the operator.
fragment	The fragment that the operator belongs to.
gxf_cid	The GXF component ID.
gxf_context	The GXF context of the component.
gxf_eid	The GXF entity ID.
gxf_typename	The GXF type name of the resource.
id	The identifier of the component.
name	The name of the operator.
operator_type	The operator type.
resources	Resources associated with the operator.

spec

Methods

OperatorType	Members:
add_arg(*args, **kwargs)	Overloaded function.
compute(self, arg0, arg1, arg2)	Operator compute method.
initialize(self)	Initialize the operator.
setup(self, spec)	Define the operator specification.
start(self)	Operator start method.
stop(self)	Operator stop method.

class OperatorType

Bases: pybind11_builtins.pybind11_object

Members:

NATIVE

GXF

Attributes

name

value

GXF =

NATIVE =

__init__(self: holoscan.core._core.Operator.OperatorType, value: int) → None

property name

property value

__init__(self: holoscan.operators._operators.FormatConverterOp, fragment: holoscan.core._core.Fragment, pool: holoscan.resources._resources.Allocator, out_dtype: str, in_dtype: str = '', in_tensor_name: str = '', out_tensor_name: str = '', scale_min: float = 0.0, scale_max: float = 1.0, alpha_value: int = 255, resize_height: int = 0, resize_width: int = 0, resize_mode: int = 0, out_channel_order: List[int] = [], name: str = 'format_converter') → None

Format conversion operator.

Parameters

fragmentFragment

The fragment that the operator belongs to.

poolholoscan.resources.Allocator

Memory pool allocator used by the operator.

out_dtypestr

Destination data type (e.g. “RGB888” or “RGBA8888”).

in_dtypestr, optional

Source data type (e.g. “RGB888” or “RGBA8888”).

in_tensor_namestr, optional

The name of the input tensor.

out_tensor_namestr, optional

The name of the output tensor.

scale_minfloat, optional

Output will be clipped to this minimum value.

scale_maxfloat, optional

Output will be clipped to this maximum value.

alpha_valueint, optional

Unsigned integer in range [0, 255], indicating the alpha channel value to use when converting from RGB to RGBA.

resize_heightint, optional

Desired height for the (resized) output. Height will be unchanged if resize_height is 0.

resize_widthint, optional

Desired width for the (resized) output. Width will be unchanged if resize_width is 0.

resize_modeint, optional

Resize mode enum value corresponding to NPP’s nppiInterpolationMode (default=NPPI_INTER_CUBIC).

channel_ordersequence of int

Sequence of integers describing how channel values are permuted.

namestr, optional

The name of the operator.

add_arg(*args, **kwargs)

Overloaded function.

1. add_arg(self: holoscan.core._core.Component, arg: holoscan.core._core.Arg) -> None

Add an argument to the component.

2. add_arg(self: holoscan.core._core.Component, arg: holoscan.core._core.ArgList) -> None

Add a list of arguments to the component.

property args

The list of arguments associated with the component.

Returns

arglistholoscan.core.ArgList

compute(self: holoscan.core._core.Operator, arg0: holoscan.core._core.InputContext, arg1: holoscan.core._core.OutputContext, arg2: holoscan.core._core.ExecutionContext) → None

Operator compute method. This method defines the primary computation to be executed by the operator.

property conditions

Conditions associated with the operator.

property fragment

The fragment that the operator belongs to.

Returns

nameholoscan.core.Fragment

property gxf_cid

The GXF component ID.

property gxf_context

The GXF context of the component.

property gxf_eid

The GXF entity ID.

property gxf_typename

The GXF type name of the resource.

Returns

str

The GXF type name of the resource

property id

The identifier of the component.

The identifier is initially set to -1, and will become a valid value when the component is initialized.

With the default executor (holoscan.gxf.GXFExecutor), the identifier is set to the GXF component ID.

Returns

idint

initialize(self: holoscan.operators._operators.FormatConverterOp) → None

Initialize the operator.

This method is called only once when the operator is created for the first time, and uses a light-weight initialization.

property name

The name of the operator.

Returns

namestr

property operator_type

The operator type.

holoscan.core.Operator.OperatorType enum representing the type of the operator. The two types currently implemented are native and GXF.

property resources

Resources associated with the operator.

setup(self: holoscan.operators._operators.FormatConverterOp, spec: holoscan.core._core.OperatorSpec) → None

Define the operator specification.

Parameters

specholoscan.core.OperatorSpec

The operator specification.

property spec

start(self: holoscan.core._core.Operator) → None

Operator start method.

stop(self: holoscan.core._core.Operator) → None

Operator stop method.

class holoscan.operators.HolovizOp(fragment, allocator=None, receivers=[], tensors=[], color_lut=[], window_title='Holoviz', display_name='DP-0', width=1920, height=1080, framerate=60, use_exclusive_display=False, fullscreen=False, headless=False, enable_render_buffer_input=False, enable_render_buffer_output=False, name='holoviz_op')

Bases: holoscan.operators._operators.HolovizOp

Holoviz visualization operator using Holoviz module.

This is a Vulkan-based visualizer.

Attributes

args	The list of arguments associated with the component.
conditions	Conditions associated with the operator.
fragment	The fragment that the operator belongs to.
gxf_cid	The GXF component ID.
gxf_context	The GXF context of the component.
gxf_eid	The GXF entity ID.
gxf_typename	The GXF type name of the resource.
id	The identifier of the component.
name	The name of the operator.
operator_type	The operator type.
resources	Resources associated with the operator.

spec

Methods

InputType	Members:
OperatorType	Members:
add_arg(*args, **kwargs)	Overloaded function.
compute(self, arg0, arg1, arg2)	Operator compute method.
initialize(self)	Initialize the operator.
setup(self, spec)	Define the operator specification.
start(self)	Operator start method.
stop(self)	Operator stop method.

InputSpec

class InputSpec

Bases: pybind11_builtins.pybind11_object

__init__(self: holoscan.operators._operators.HolovizOp.InputSpec, arg0: str, arg1: holoscan.operators._operators.HolovizOp.InputType) → None

class InputType

Bases: pybind11_builtins.pybind11_object

Members:

UNKNOWN

COLOR

COLOR_LUT

POINTS

LINES

LINE_STRIP

TRIANGLES

CROSSES

RECTANGLES

OVALS

TEXT

Attributes

name

value

COLOR =

COLOR_LUT =

CROSSES =

LINES =

LINE_STRIP =

OVALS =

POINTS =

RECTANGLES =

TEXT =

TRIANGLES =

UNKNOWN =

__init__(self: holoscan.operators._operators.HolovizOp.InputType, value: int) → None

property name

property value

class OperatorType

Bases: pybind11_builtins.pybind11_object

Members:

NATIVE

GXF

Attributes

name

value

GXF =

NATIVE =

__init__(self: holoscan.core._core.Operator.OperatorType, value: int) → None

property name

property value

__init__(self: holoscan.operators._operators.HolovizOp, fragment: holoscan.core._core.Fragment, allocator: holoscan.resources._resources.Allocator, receivers: List[holoscan.core._core.IOSpec] = [], tensors: List[holoscan::ops::HolovizOp::InputSpec] = [], color_lut: List[List[float]] = [], window_title: str = 'Holoviz', display_name: str = 'DP-0', width: int = 1920, height: int = 1080, framerate: int = 60, use_exclusive_display: bool = False, fullscreen: bool = False, headless: bool = False, enable_render_buffer_input: bool = False, enable_render_buffer_output: bool = False, name: str = 'holoviz_op') → None

Holoviz visualization operator using Holoviz module.

This is a Vulkan-based visualizer.

Parameters

fragmentFragment

The fragment that the operator belongs to.

allocatorholoscan.core.Allocator, optional

Allocator used to allocate render buffer output. If None, will default to holoscan.core.UnboundedAllocator.

receiverssequence of holoscan.core.IOSpec, optional

List of input receivers.

tensorssequence of holoscan.core.InputSpec, optional

List of input tensors. ‘name’ is required, ‘type’ is optional (unknown, color, color_lut, points, lines, line_strip, triangles, crosses, rectangles, ovals, text).

color_lutlist of list of float, optional

Color lookup table for tensors of type ‘color_lut’. Should be shape (n_colors, 4).

window_titlestr, optional

Title on window canvas.

display_namestr, optional

In exclusive mode, name of display to use as shown with xrandr.

widthint, optional

Window width or display resolution width if in exclusive or fullscreen mode.

heightint, optional

Window height or display resolution width if in exclusive or fullscreen mode.

framerateint, optional

Display framerate if in exclusive mode.

use_exclusive_displaybool, optional

Enable exclusive display.

fullscreenbool, optional

Enable fullscreen window.

headlessbool, optional

Enable headless mode. No window is opened, the render buffer is output to port render_buffer_output.

enable_render_buffer_inputbool, optional

If True, an additional input port, named render_buffer_input is added to the operator.

enable_render_buffer_outputbool, optional

If True, an additional output port, named render_buffer_output is added to the operator.

namestr, optional

The name of the operator.

add_arg(*args, **kwargs)

Overloaded function.

1. add_arg(self: holoscan.core._core.Component, arg: holoscan.core._core.Arg) -> None

Add an argument to the component.

2. add_arg(self: holoscan.core._core.Component, arg: holoscan.core._core.ArgList) -> None

Add a list of arguments to the component.

property args

The list of arguments associated with the component.

Returns

arglistholoscan.core.ArgList

compute(self: holoscan.core._core.Operator, arg0: holoscan.core._core.InputContext, arg1: holoscan.core._core.OutputContext, arg2: holoscan.core._core.ExecutionContext) → None

Operator compute method. This method defines the primary computation to be executed by the operator.

property conditions

Conditions associated with the operator.

property fragment

The fragment that the operator belongs to.

Returns

nameholoscan.core.Fragment

property gxf_cid

The GXF component ID.

property gxf_context

The GXF context of the component.

property gxf_eid

The GXF entity ID.

property gxf_typename

The GXF type name of the resource.

Returns

str

The GXF type name of the resource

property id

The identifier of the component.

The identifier is initially set to -1, and will become a valid value when the component is initialized.

With the default executor (holoscan.gxf.GXFExecutor), the identifier is set to the GXF component ID.

Returns

idint

initialize(self: holoscan.operators._operators.HolovizOp) → None

Initialize the operator.

This method is called only once when the operator is created for the first time, and uses a light-weight initialization.

property name

The name of the operator.

Returns

namestr

property operator_type

The operator type.

holoscan.core.Operator.OperatorType enum representing the type of the operator. The two types currently implemented are native and GXF.

property resources

Resources associated with the operator.

setup(self: holoscan.operators._operators.HolovizOp, spec: holoscan.core._core.OperatorSpec) → None

Define the operator specification.

Parameters

specholoscan.core.OperatorSpec

The operator specification.

property spec

start(self: holoscan.core._core.Operator) → None

Operator start method.

stop(self: holoscan.core._core.Operator) → None

Operator stop method.

class holoscan.operators.LSTMTensorRTInferenceOp(fragment, pool, cuda_stream_pool, model_file_path, engine_cache_dir, input_tensor_names, input_state_tensor_names, input_binding_names, output_tensor_names, output_state_tensor_names, output_binding_names, max_workspace_size, force_engine_update=False, verbose=True, enable_fp16_=True, name='lstm_inferer')

Bases: holoscan.operators._operators.LSTMTensorRTInferenceOp

Operator class to perform inference using an LSTM model.

Attributes

args	The list of arguments associated with the component.
conditions	Conditions associated with the operator.
fragment	The fragment that the operator belongs to.
gxf_cid	The GXF component ID.
gxf_context	The GXF context of the component.
gxf_eid	The GXF entity ID.
gxf_typename	The GXF type name of the resource.
id	The identifier of the component.
name	The name of the operator.
operator_type	The operator type.
resources	Resources associated with the operator.

spec

Methods

OperatorType	Members:
add_arg(*args, **kwargs)	Overloaded function.
compute(self, arg0, arg1, arg2)	Operator compute method.
initialize(self)	Initialize the operator.
setup(self, spec)	Define the operator specification.
start(self)	Operator start method.
stop(self)	Operator stop method.

class OperatorType

Bases: pybind11_builtins.pybind11_object

Members:

NATIVE

GXF

Attributes

name

value

GXF =

NATIVE =

__init__(self: holoscan.core._core.Operator.OperatorType, value: int) → None

property name

property value

__init__(self: holoscan.operators._operators.LSTMTensorRTInferenceOp, fragment: holoscan.core._core.Fragment, input_tensor_names: List[str], output_tensor_names: List[str], input_binding_names: List[str], output_binding_names: List[str], model_file_path: str, engine_cache_dir: str, pool: holoscan.resources._resources.Allocator, cuda_stream_pool: holoscan.resources._resources.CudaStreamPool, plugins_lib_namespace: str = '', input_state_tensor_names: List[str] = [], output_state_tensor_names: List[str] = [], force_engine_update: bool = False, enable_fp16_: bool = False, verbose: bool = False, relaxed_dimension_check: bool = True, max_workspace_size: int = 67108864, max_batch_size: int = 1, name: str = 'lstm_tensor_rt_inference') → None

Operator class to perform inference using an LSTM model.

Parameters

fragmentFragment

The fragment that the operator belongs to.

input_tensor_namessequence of str

Names of input tensors in the order to be fed into the model.

output_tensor_namessequence of str

Names of output tensors in the order to be retrieved from the model.

input_binding_namessequence of str

Names of input bindings as in the model in the same order of what is provided in input_tensor_names.

output_binding_namessequence of str

Names of output bindings as in the model in the same order of what is provided in output_tensor_names.

model_file_pathstr

Path to the ONNX model to be loaded.

engine_cache_dirstr

Path to a folder containing cached engine files to be serialized and loaded from.

poolholoscan.resources.Allocator

Allocator instance for output tensors.

cuda_stream_poolholoscan.resources.CudaStreamPool

CudaStreamPool instance to allocate CUDA streams.

plugins_lib_namespacestr

Namespace used to register all the plugins in this library.

input_state_tensor_namessequence of str, optional

Names of input state tensors that are used internally by TensorRT.

output_state_tensor_namessequence of str, optional

Names of output state tensors that are used internally by TensorRT.

force_engine_updatebool, optional

Always update engine regardless of whether there is an existing engine file. Warning: this may take minutes to complete, so is False by default.

enable_fp16bool, optional

Enable inference with FP16 and FP32 fallback.

verbosebool, optional

Enable verbose logging to the console.

relaxed_dimension_checkbool, optional

Ignore dimensions of 1 for input tensor dimension check.

max_workspace_sizeint, optional

Size of working space in bytes.

max_batch_sizeint, optional

Maximum possible batch size in case the first dimension is dynamic and used as batch size.

namestr, optional

The name of the operator.

add_arg(*args, **kwargs)

Overloaded function.

1. add_arg(self: holoscan.core._core.Component, arg: holoscan.core._core.Arg) -> None

Add an argument to the component.

2. add_arg(self: holoscan.core._core.Component, arg: holoscan.core._core.ArgList) -> None

Add a list of arguments to the component.

property args

The list of arguments associated with the component.

Returns

arglistholoscan.core.ArgList

compute(self: holoscan.core._core.Operator, arg0: holoscan.core._core.InputContext, arg1: holoscan.core._core.OutputContext, arg2: holoscan.core._core.ExecutionContext) → None

Operator compute method. This method defines the primary computation to be executed by the operator.

property conditions

Conditions associated with the operator.

property fragment

The fragment that the operator belongs to.

Returns

nameholoscan.core.Fragment

property gxf_cid

The GXF component ID.

property gxf_context

The GXF context of the component.

property gxf_eid

The GXF entity ID.

property gxf_typename

The GXF type name of the resource.

Returns

str

The GXF type name of the resource

property id

The identifier of the component.

The identifier is initially set to -1, and will become a valid value when the component is initialized.

With the default executor (holoscan.gxf.GXFExecutor), the identifier is set to the GXF component ID.

Returns

idint

initialize(self: holoscan.operators._operators.LSTMTensorRTInferenceOp) → None

Initialize the operator.

This method is called only once when the operator is created for the first time, and uses a light-weight initialization.

property name

The name of the operator.

Returns

namestr

property operator_type

The operator type.

holoscan.core.Operator.OperatorType enum representing the type of the operator. The two types currently implemented are native and GXF.

property resources

Resources associated with the operator.

setup(self: holoscan.operators._operators.LSTMTensorRTInferenceOp, spec: holoscan.core._core.OperatorSpec) → None

Define the operator specification.

Parameters

specholoscan.core.OperatorSpec

The operator specification.

property spec

start(self: holoscan.core._core.Operator) → None

Operator start method.

stop(self: holoscan.core._core.Operator) → None

Operator stop method.

class holoscan.operators.MultiAIInferenceOp

Bases: holoscan.gxf._gxf.GXFOperator

Multi-AI inference operator.

Attributes

args	The list of arguments associated with the component.
conditions	Conditions associated with the operator.
fragment	The fragment that the operator belongs to.
gxf_cid	The GXF component ID.
gxf_context	The GXF context of the component.
gxf_eid	The GXF entity ID.
gxf_typename	The GXF type name of the resource.
id	The identifier of the component.
name	The name of the operator.
operator_type	The operator type.
resources	Resources associated with the operator.

spec

Methods

OperatorType	Members:
add_arg(*args, **kwargs)	Overloaded function.
compute(self, arg0, arg1, arg2)	Operator compute method.
initialize(self)	Initialize the operator.
setup(self, spec)	Define the operator specification.
start(self)	Operator start method.
stop(self)	Operator stop method.

DataMap
DataVecMap

class DataMap

Bases: pybind11_builtins.pybind11_object

Methods

get_map(self)
insert(self)

__init__(self: holoscan.operators._operators.MultiAIInferenceOp.DataMap) → None

get_map(self: holoscan.operators._operators.MultiAIInferenceOp.DataMap) → Dict[str, str]

insert(self: holoscan.operators._operators.MultiAIInferenceOp.DataMap) → Dict[str, str]

class DataVecMap

Bases: pybind11_builtins.pybind11_object

Methods

get_map(self)
insert(self)

__init__(self: holoscan.operators._operators.MultiAIInferenceOp.DataVecMap) → None

get_map(self: holoscan.operators._operators.MultiAIInferenceOp.DataVecMap) → Dict[str, List[str]]

insert(self: holoscan.operators._operators.MultiAIInferenceOp.DataVecMap) → Dict[str, List[str]]

class OperatorType

Bases: pybind11_builtins.pybind11_object

Members:

NATIVE

GXF

Attributes

name

value

GXF =

NATIVE =

__init__(self: holoscan.core._core.Operator.OperatorType, value: int) → None

property name

property value

__init__(self: holoscan.operators._operators.MultiAIInferenceOp, fragment: holoscan.core._core.Fragment, backend: str, allocator: holoscan.resources._resources.Allocator, inference_map: dict, model_path_map: dict, pre_processor_map: dict, in_tensor_names: List[str] = [''], out_tensor_names: List[str] = [''], infer_on_cpu: bool = False, parallel_inference: bool = True, input_on_cuda: bool = True, output_on_cuda: bool = True, transmit_on_cuda: bool = True, enable_fp16: bool = False, is_engine_path: bool = False, name: str = 'multi_ai_inference') → None

Multi-AI inference operator.

Parameters

fragmentFragment

The fragment that the operator belongs to.

backend{“trt”, “onnxrt”}

Backend to use for inference. Set “trt” for TensorRT and “onnxrt” for the ONNX runtime.

allocatorholoscan.resources.Allocator

Memory allocator to use for the output.

inference_mapholoscan.operators.MultiAIInferenceOp.DataMap

Tensor to model map.

model_path_mapholoscan.operators.MultiAIInferenceOp.DataMap

Path to the ONNX model to be loaded.

pre_processor_mapholoscan.operators.MultiAIInferenceOp::DataVecMap

Pre processed data to model map.

in_tensor_namessequence of str, optional

Input tensors.

out_tensor_namessequence of str, optional

Output tensors.

infer_on_cpubool, optional

Whether to run the computation on the CPU instead of GPU.

parallel_inferencebool, optional

Whether to enable parallel execution.

input_on_cudabool, optional

Whether the input buffer is on the GPU.

output_on_cudabool, optional

Whether the output buffer is on the GPU.

transmit_on_cudabool, optional

Whether to transmit the message on the GPU.

enable_fp16bool, optional

Use 16-bit floating point computations.

is_engine_pathbool, optional

Whether the input model path mapping is for trt engine files

namestr, optional

The name of the operator.

add_arg(*args, **kwargs)

Overloaded function.

1. add_arg(self: holoscan.core._core.Component, arg: holoscan.core._core.Arg) -> None

Add an argument to the component.

2. add_arg(self: holoscan.core._core.Component, arg: holoscan.core._core.ArgList) -> None

Add a list of arguments to the component.

property args

The list of arguments associated with the component.

Returns

arglistholoscan.core.ArgList

compute(self: holoscan.core._core.Operator, arg0: holoscan.core._core.InputContext, arg1: holoscan.core._core.OutputContext, arg2: holoscan.core._core.ExecutionContext) → None

Operator compute method. This method defines the primary computation to be executed by the operator.

property conditions

Conditions associated with the operator.

property fragment

The fragment that the operator belongs to.

Returns

nameholoscan.core.Fragment

property gxf_cid

The GXF component ID.

property gxf_context

The GXF context of the component.

property gxf_eid

The GXF entity ID.

property gxf_typename

The GXF type name of the resource.

Returns

str

The GXF type name of the resource

property id

The identifier of the component.

The identifier is initially set to -1, and will become a valid value when the component is initialized.

With the default executor (holoscan.gxf.GXFExecutor), the identifier is set to the GXF component ID.

Returns

idint

initialize(self: holoscan.operators._operators.MultiAIInferenceOp) → None

Initialize the operator.

This method is called only once when the operator is created for the first time, and uses a light-weight initialization.

property name

The name of the operator.

Returns

namestr

property operator_type

The operator type.

holoscan.core.Operator.OperatorType enum representing the type of the operator. The two types currently implemented are native and GXF.

property resources

Resources associated with the operator.

setup(self: holoscan.operators._operators.MultiAIInferenceOp, spec: holoscan.core._core.OperatorSpec) → None

Define the operator specification.

Parameters

specholoscan.core.OperatorSpec

The operator specification.

property spec

start(self: holoscan.core._core.Operator) → None

Operator start method.

stop(self: holoscan.core._core.Operator) → None

Operator stop method.

class holoscan.operators.MultiAIPostprocessorOp

Bases: holoscan.gxf._gxf.GXFOperator

Multi-AI post-processing operator.

Attributes

args	The list of arguments associated with the component.
conditions	Conditions associated with the operator.
fragment	The fragment that the operator belongs to.
gxf_cid	The GXF component ID.
gxf_context	The GXF context of the component.
gxf_eid	The GXF entity ID.
gxf_typename	The GXF type name of the resource.
id	The identifier of the component.
name	The name of the operator.
operator_type	The operator type.
resources	Resources associated with the operator.

spec

Methods

OperatorType	Members:
add_arg(*args, **kwargs)	Overloaded function.
compute(self, arg0, arg1, arg2)	Operator compute method.
initialize(self)	Initialize the operator.
setup(self, spec)	Define the operator specification.
start(self)	Operator start method.
stop(self)	Operator stop method.

DataMap
DataVecMap

class DataMap

Bases: pybind11_builtins.pybind11_object

Methods

get_map(self)
insert(self)

__init__(self: holoscan.operators._operators.MultiAIPostprocessorOp.DataMap) → None

get_map(self: holoscan.operators._operators.MultiAIPostprocessorOp.DataMap) → Dict[str, str]

insert(self: holoscan.operators._operators.MultiAIPostprocessorOp.DataMap) → Dict[str, str]

class DataVecMap

Bases: pybind11_builtins.pybind11_object

Methods

get_map(self)
insert(self)

__init__(self: holoscan.operators._operators.MultiAIPostprocessorOp.DataVecMap) → None

get_map(self: holoscan.operators._operators.MultiAIPostprocessorOp.DataVecMap) → Dict[str, List[str]]

insert(self: holoscan.operators._operators.MultiAIPostprocessorOp.DataVecMap) → Dict[str, List[str]]

class OperatorType

Bases: pybind11_builtins.pybind11_object

Members:

NATIVE

GXF

Attributes

name

value

GXF =

NATIVE =

__init__(self: holoscan.core._core.Operator.OperatorType, value: int) → None

property name

property value

__init__(self: holoscan.operators._operators.MultiAIPostprocessorOp, fragment: holoscan.core._core.Fragment, allocator: holoscan.resources._resources.Allocator, process_operations: dict, processed_map: dict, in_tensor_names: List[str] = [''], out_tensor_names: List[str] = [''], input_on_cuda: bool = False, output_on_cuda: bool = False, transmit_on_cuda: bool = False, name: str = 'multi_ai_postprocessor') → None

Multi-AI post-processing operator.

Parameters

fragmentFragment

The fragment that the operator belongs to.

allocatorholoscan.resources.Allocator

Memory allocator to use for the output.

post_processor_mapholoscan.operators.MultiAIPostprocessorOp.DataVecMap

All post processor settings for each model.

process_operationsholoscan.operators.MultiAIPostprocessorOp.DataVecMap

Operations in sequence on tensors.

processed_mapholoscan.operators.MultiAIPostprocessorOp::DataMap

Input-output tensor mapping.

in_tensor_namessequence of str, optional

Names of input tensors in the order to be fed into the operator.

out_tensor_namessequence of str, optional

Names of output tensors in the order to be fed into the operator.

input_on_cudabool, optional

Whether the input buffer is on the GPU.

output_on_cudabool, optional

Whether the output buffer is on the GPU.

transmit_on_cudabool, optional

Whether to transmit the message on the GPU.

namestr, optional

The name of the operator.

add_arg(*args, **kwargs)

Overloaded function.

1. add_arg(self: holoscan.core._core.Component, arg: holoscan.core._core.Arg) -> None

Add an argument to the component.

2. add_arg(self: holoscan.core._core.Component, arg: holoscan.core._core.ArgList) -> None

Add a list of arguments to the component.

property args

The list of arguments associated with the component.

Returns

arglistholoscan.core.ArgList

compute(self: holoscan.core._core.Operator, arg0: holoscan.core._core.InputContext, arg1: holoscan.core._core.OutputContext, arg2: holoscan.core._core.ExecutionContext) → None

Operator compute method. This method defines the primary computation to be executed by the operator.

property conditions

Conditions associated with the operator.

property fragment

The fragment that the operator belongs to.

Returns

nameholoscan.core.Fragment

property gxf_cid

The GXF component ID.

property gxf_context

The GXF context of the component.

property gxf_eid

The GXF entity ID.

property gxf_typename

The GXF type name of the resource.

Returns

str

The GXF type name of the resource

property id

The identifier of the component.

The identifier is initially set to -1, and will become a valid value when the component is initialized.

With the default executor (holoscan.gxf.GXFExecutor), the identifier is set to the GXF component ID.

Returns

idint

initialize(self: holoscan.operators._operators.MultiAIPostprocessorOp) → None

Initialize the operator.

This method is called only once when the operator is created for the first time, and uses a light-weight initialization.

property name

The name of the operator.

Returns

namestr

property operator_type

The operator type.

holoscan.core.Operator.OperatorType enum representing the type of the operator. The two types currently implemented are native and GXF.

property resources

Resources associated with the operator.

setup(self: holoscan.operators._operators.MultiAIPostprocessorOp, spec: holoscan.core._core.OperatorSpec) → None

Define the operator specification.

Parameters

specholoscan.core.OperatorSpec

The operator specification.

property spec

start(self: holoscan.core._core.Operator) → None

Operator start method.

stop(self: holoscan.core._core.Operator) → None

Operator stop method.

class holoscan.operators.NTV2Channel

Bases: pybind11_builtins.pybind11_object

Members:

NTV2_CHANNEL1

NTV2_CHANNEL2

NTV2_CHANNEL3

NTV2_CHANNEL4

NTV2_CHANNEL5

NTV2_CHANNEL6

NTV2_CHANNEL7

NTV2_CHANNEL8

NTV2_MAX_NUM_CHANNELS

NTV2_CHANNEL_INVALID

Attributes

name

value

NTV2_CHANNEL1 =

NTV2_CHANNEL2 =

NTV2_CHANNEL3 =

NTV2_CHANNEL4 =

NTV2_CHANNEL5 =

NTV2_CHANNEL6 =

NTV2_CHANNEL7 =

NTV2_CHANNEL8 =

NTV2_CHANNEL_INVALID =

NTV2_MAX_NUM_CHANNELS =

__init__(self: holoscan.operators._operators.NTV2Channel, value: int) → None

property name

property value

class holoscan.operators.SegmentationPostprocessorOp

Bases: holoscan.gxf._gxf.GXFOperator

Operator carrying out post-processing operations used in the ultrasound demo app.

Attributes

args	The list of arguments associated with the component.
conditions	Conditions associated with the operator.
fragment	The fragment that the operator belongs to.
gxf_cid	The GXF component ID.
gxf_context	The GXF context of the component.
gxf_eid	The GXF entity ID.
gxf_typename	The GXF type name of the resource.
id	The identifier of the component.
name	The name of the operator.
operator_type	The operator type.
resources	Resources associated with the operator.

spec

Methods

OperatorType	Members:
add_arg(*args, **kwargs)	Overloaded function.
compute(self, arg0, arg1, arg2)	Operator compute method.
initialize(self)	Operator initialization method.
setup(self, spec)	Define the operator specification.
start(self)	Operator start method.
stop(self)	Operator stop method.

class OperatorType

Bases: pybind11_builtins.pybind11_object

Members:

NATIVE

GXF

Attributes

name

value

GXF =

NATIVE =

__init__(self: holoscan.core._core.Operator.OperatorType, value: int) → None

property name

property value

__init__(self: holoscan.operators._operators.SegmentationPostprocessorOp, fragment: holoscan.core._core.Fragment, allocator: holoscan.resources._resources.Allocator, in_tensor_name: str = '', network_output_type: str = 'softmax', data_format: str = 'hwc', name: str = 'segmentation_postprocessor') → None

Operator carrying out post-processing operations used in the ultrasound demo app.

Parameters

fragmentFragment

The fragment that the operator belongs to.

allocatorholoscan.resources.Allocator

Memory allocator to use for the output.

in_tensor_namestr, optional

Name of the input tensor.

network_output_typestr, optional

Network output type (e.g. ‘softmax’).

data_formatstr, optional

Data format of network output.

namestr, optional

The name of the operator.

add_arg(*args, **kwargs)

Overloaded function.

1. add_arg(self: holoscan.core._core.Component, arg: holoscan.core._core.Arg) -> None

Add an argument to the component.

2. add_arg(self: holoscan.core._core.Component, arg: holoscan.core._core.ArgList) -> None

Add a list of arguments to the component.

property args

The list of arguments associated with the component.

Returns

arglistholoscan.core.ArgList

compute(self: holoscan.core._core.Operator, arg0: holoscan.core._core.InputContext, arg1: holoscan.core._core.OutputContext, arg2: holoscan.core._core.ExecutionContext) → None

Operator compute method. This method defines the primary computation to be executed by the operator.

property conditions

Conditions associated with the operator.

property fragment

The fragment that the operator belongs to.

Returns

nameholoscan.core.Fragment

property gxf_cid

The GXF component ID.

property gxf_context

The GXF context of the component.

property gxf_eid

The GXF entity ID.

property gxf_typename

The GXF type name of the resource.

Returns

str

The GXF type name of the resource

property id

The identifier of the component.

The identifier is initially set to -1, and will become a valid value when the component is initialized.

With the default executor (holoscan.gxf.GXFExecutor), the identifier is set to the GXF component ID.

Returns

idint

initialize(self: holoscan.core._core.Operator) → None

Operator initialization method.

property name

The name of the operator.

Returns

namestr

property operator_type

The operator type.

holoscan.core.Operator.OperatorType enum representing the type of the operator. The two types currently implemented are native and GXF.

property resources

Resources associated with the operator.

setup(self: holoscan.operators._operators.SegmentationPostprocessorOp, spec: holoscan.core._core.OperatorSpec) → None

Define the operator specification.

Parameters

specholoscan.core.OperatorSpec

The operator specification.

property spec

start(self: holoscan.core._core.Operator) → None

Operator start method.

stop(self: holoscan.core._core.Operator) → None

Operator stop method.

class holoscan.operators.TensorRTInferenceOp

Bases: holoscan.gxf._gxf.GXFOperator

Operator class to perform inference using TensorRT.

Attributes

args	The list of arguments associated with the component.
conditions	Conditions associated with the operator.
fragment	The fragment that the operator belongs to.
gxf_cid	The GXF component ID.
gxf_context	The GXF context of the component.
gxf_eid	The GXF entity ID.
gxf_typename	The GXF type name of the resource.
id	The identifier of the component.
name	The name of the operator.
operator_type	The operator type.
resources	Resources associated with the operator.

spec

Methods

OperatorType	Members:
add_arg(*args, **kwargs)	Overloaded function.
compute(self, arg0, arg1, arg2)	Operator compute method.
initialize(self)	Initialize the operator.
setup(self, spec)	Define the operator specification.
start(self)	Operator start method.
stop(self)	Operator stop method.

class OperatorType

Bases: pybind11_builtins.pybind11_object

Members:

NATIVE

GXF

Attributes

name

value

GXF =

NATIVE =

__init__(self: holoscan.core._core.Operator.OperatorType, value: int) → None

property name

property value

__init__(self: holoscan.operators._operators.TensorRTInferenceOp, fragment: holoscan.core._core.Fragment, model_file_path: str, engine_cache_dir: str, input_tensor_names: List[str], input_binding_names: List[str], output_tensor_names: List[str], output_binding_names: List[str], pool: holoscan.resources._resources.Allocator, cuda_stream_pool: holoscan.resources._resources.CudaStreamPool, plugins_lib_namespace: str = '', force_engine_update: bool = False, max_workspace_size: int = 67108864, max_batch_size: int = 1, enable_fp16_: bool = False, relaxed_dimension_check: bool = True, verbose: bool = False, name: str = 'tensor_rt_inference') → None

Operator class to perform inference using TensorRT.

Parameters

fragmentFragment

The fragment that the operator belongs to.

model_file_pathstr

Path to the ONNX model to be loaded.

engine_cache_dirstr

Path to a folder containing cached engine files to be serialized and loaded from.

input_tensor_namessequence of str

Names of input tensors in the order to be fed into the model.

input_binding_namessequence of str

Names of input bindings as in the model in the same order of what is provided in input_tensor_names.

output_tensor_namessequence of str

Names of output tensors in the order to be retrieved from the model.

output_binding_namessequence of str

Names of output bindings as in the model in the same order of what is provided in output_tensor_names.

poolholoscan.resources.Allocator

Allocator instance for output tensors.

cuda_stream_poolholoscan.resources.CudaStreamPool

CudaStreamPool instance to allocate CUDA streams.

plugins_lib_namespacestr

Namespace used to register all the plugins in this library.

force_engine_updatebool, optional

Always update engine regardless of whether there is an existing engine file. Warning: this may take minutes to complete, so is False by default.

max_workspace_sizeint, optional

Size of working space in bytes.

max_batch_sizeint, optional

Maximum possible batch size in case the first dimension is dynamic and used as batch size.

enable_fp16bool, optional

Enable inference with FP16 and FP32 fallback.

relaxed_dimension_checkbool, optional

Ignore dimensions of 1 for input tensor dimension check.

verbosebool, optional

Enable verbose logging to the console.

namestr, optional

The name of the operator.

add_arg(*args, **kwargs)

Overloaded function.

1. add_arg(self: holoscan.core._core.Component, arg: holoscan.core._core.Arg) -> None

Add an argument to the component.

2. add_arg(self: holoscan.core._core.Component, arg: holoscan.core._core.ArgList) -> None

Add a list of arguments to the component.

property args

The list of arguments associated with the component.

Returns

arglistholoscan.core.ArgList

compute(self: holoscan.core._core.Operator, arg0: holoscan.core._core.InputContext, arg1: holoscan.core._core.OutputContext, arg2: holoscan.core._core.ExecutionContext) → None

Operator compute method. This method defines the primary computation to be executed by the operator.

property conditions

Conditions associated with the operator.

property fragment

The fragment that the operator belongs to.

Returns

nameholoscan.core.Fragment

property gxf_cid

The GXF component ID.

property gxf_context

The GXF context of the component.

property gxf_eid

The GXF entity ID.

property gxf_typename

The GXF type name of the resource.

Returns

str

The GXF type name of the resource

property id

The identifier of the component.

The identifier is initially set to -1, and will become a valid value when the component is initialized.

With the default executor (holoscan.gxf.GXFExecutor), the identifier is set to the GXF component ID.

Returns

idint

initialize(self: holoscan.operators._operators.TensorRTInferenceOp) → None

Initialize the operator.

This method is called only once when the operator is created for the first time, and uses a light-weight initialization.

property name

The name of the operator.

Returns

namestr

property operator_type

The operator type.

holoscan.core.Operator.OperatorType enum representing the type of the operator. The two types currently implemented are native and GXF.

property resources

Resources associated with the operator.

setup(self: holoscan.operators._operators.TensorRTInferenceOp, spec: holoscan.core._core.OperatorSpec) → None

Define the operator specification.

Parameters

specholoscan.core.OperatorSpec

The operator specification.

property spec

start(self: holoscan.core._core.Operator) → None

Operator start method.

stop(self: holoscan.core._core.Operator) → None

Operator stop method.

class holoscan.operators.ToolTrackingPostprocessorOp

Bases: holoscan.gxf._gxf.GXFOperator

Operator performing post-processing for the endoscopy tool tracking demo.

Attributes

args	The list of arguments associated with the component.
conditions	Conditions associated with the operator.
fragment	The fragment that the operator belongs to.
gxf_cid	The GXF component ID.
gxf_context	The GXF context of the component.
gxf_eid	The GXF entity ID.
gxf_typename	The GXF type name of the resource.
id	The identifier of the component.
name	The name of the operator.
operator_type	The operator type.
resources	Resources associated with the operator.

spec

Methods

OperatorType	Members:
add_arg(*args, **kwargs)	Overloaded function.
compute(self, arg0, arg1, arg2)	Operator compute method.
initialize(self)	Operator initialization method.
setup(self, spec)	Define the operator specification.
start(self)	Operator start method.
stop(self)	Operator stop method.

class OperatorType

Bases: pybind11_builtins.pybind11_object

Members:

NATIVE

GXF

Attributes

name

value

GXF =

NATIVE =

__init__(self: holoscan.core._core.Operator.OperatorType, value: int) → None

property name

property value

__init__(self: holoscan.operators._operators.ToolTrackingPostprocessorOp, fragment: holoscan.core._core.Fragment, device_allocator: holoscan.resources._resources.Allocator, host_allocator: holoscan.resources._resources.Allocator, min_prob: float = 0.5, overlay_img_colors: List[List[float]] = [[0.11999999731779099, 0.4699999988079071, 0.7099999785423279], [0.20000000298023224, 0.6299999952316284, 0.17000000178813934], [0.8899999856948853, 0.10000000149011612, 0.10999999940395355], [1.0, 0.5, 0.0], [0.41999998688697815, 0.23999999463558197, 0.6000000238418579], [0.6899999976158142, 0.3499999940395355, 0.1599999964237213], [0.6499999761581421, 0.8100000023841858, 0.8899999856948853], [0.699999988079071, 0.8700000047683716, 0.5400000214576721], [0.9800000190734863, 0.6000000238418579, 0.6000000238418579], [0.9900000095367432, 0.75, 0.4399999976158142], [0.7900000214576721, 0.699999988079071, 0.8399999737739563], [1.0, 1.0, 0.6000000238418579]], name: str = 'tool_tracking_postprocessor') → None

Operator performing post-processing for the endoscopy tool tracking demo.

Parameters

fragmentFragment

The fragment that the operator belongs to.

device_allocatorholoscan.resources.Allocator

Output allocator used on the device side.

host_allocatorholoscan.resources.Allocator

Output allocator used on the host side.

min_probfloat, optional

Minimum probability (in range [0, 1]).

overlay_img_colorssequence of sequence of float, optional

Color of the image overlays, a list of RGB values with components between 0 and 1.

namestr, optional

The name of the operator.

add_arg(*args, **kwargs)

Overloaded function.

1. add_arg(self: holoscan.core._core.Component, arg: holoscan.core._core.Arg) -> None

Add an argument to the component.

2. add_arg(self: holoscan.core._core.Component, arg: holoscan.core._core.ArgList) -> None

Add a list of arguments to the component.

property args

The list of arguments associated with the component.

Returns

arglistholoscan.core.ArgList

compute(self: holoscan.core._core.Operator, arg0: holoscan.core._core.InputContext, arg1: holoscan.core._core.OutputContext, arg2: holoscan.core._core.ExecutionContext) → None

Operator compute method. This method defines the primary computation to be executed by the operator.

property conditions

Conditions associated with the operator.

property fragment

The fragment that the operator belongs to.

Returns

nameholoscan.core.Fragment

property gxf_cid

The GXF component ID.

property gxf_context

The GXF context of the component.

property gxf_eid

The GXF entity ID.

property gxf_typename

The GXF type name of the resource.

Returns

str

The GXF type name of the resource

property id

The identifier of the component.

The identifier is initially set to -1, and will become a valid value when the component is initialized.

With the default executor (holoscan.gxf.GXFExecutor), the identifier is set to the GXF component ID.

Returns

idint

initialize(self: holoscan.core._core.Operator) → None

Operator initialization method.

property name

The name of the operator.

Returns

namestr

property operator_type

The operator type.

holoscan.core.Operator.OperatorType enum representing the type of the operator. The two types currently implemented are native and GXF.

property resources

Resources associated with the operator.

setup(self: holoscan.operators._operators.ToolTrackingPostprocessorOp, spec: holoscan.core._core.OperatorSpec) → None

Define the operator specification.

Parameters

specholoscan.core.OperatorSpec

The operator specification.

property spec

start(self: holoscan.core._core.Operator) → None

Operator start method.

stop(self: holoscan.core._core.Operator) → None

Operator stop method.

class holoscan.operators.VideoStreamRecorderOp

Bases: holoscan.gxf._gxf.GXFOperator

Operator class to record the video stream to a file.

Attributes

args	The list of arguments associated with the component.
conditions	Conditions associated with the operator.
fragment	The fragment that the operator belongs to.
gxf_cid	The GXF component ID.
gxf_context	The GXF context of the component.
gxf_eid	The GXF entity ID.
gxf_typename	The GXF type name of the resource.
id	The identifier of the component.
name	The name of the operator.
operator_type	The operator type.
resources	Resources associated with the operator.

spec

Methods

OperatorType	Members:
add_arg(*args, **kwargs)	Overloaded function.
compute(self, arg0, arg1, arg2)	Operator compute method.
initialize(self)	Initialize the operator.
setup(self, spec)	Define the operator specification.
start(self)	Operator start method.
stop(self)	Operator stop method.

class OperatorType

Bases: pybind11_builtins.pybind11_object

Members:

NATIVE

GXF

Attributes

name

value

GXF =

NATIVE =

__init__(self: holoscan.core._core.Operator.OperatorType, value: int) → None

property name

property value

__init__(self: holoscan.operators._operators.VideoStreamRecorderOp, fragment: holoscan.core._core.Fragment, directory: str, basename: str, flush_on_tick: bool = False, name: str = 'recorder') → None

Operator class to record the video stream to a file.

Parameters

fragmentFragment

The fragment that the operator belongs to.

directorystr

Directory path for storing files.

basenamestr

User specified file name without extension.

flush_on_tickbool, optional

Flushes output buffer on every tick when True.

namestr, optional

The name of the operator.

add_arg(*args, **kwargs)

Overloaded function.

1. add_arg(self: holoscan.core._core.Component, arg: holoscan.core._core.Arg) -> None

Add an argument to the component.

2. add_arg(self: holoscan.core._core.Component, arg: holoscan.core._core.ArgList) -> None

Add a list of arguments to the component.

property args

The list of arguments associated with the component.

Returns

arglistholoscan.core.ArgList

compute(self: holoscan.core._core.Operator, arg0: holoscan.core._core.InputContext, arg1: holoscan.core._core.OutputContext, arg2: holoscan.core._core.ExecutionContext) → None

Operator compute method. This method defines the primary computation to be executed by the operator.

property conditions

Conditions associated with the operator.

property fragment

The fragment that the operator belongs to.

Returns

nameholoscan.core.Fragment

property gxf_cid

The GXF component ID.

property gxf_context

The GXF context of the component.

property gxf_eid

The GXF entity ID.

property gxf_typename

The GXF type name of the resource.

Returns

str

The GXF type name of the resource

property id

The identifier of the component.

The identifier is initially set to -1, and will become a valid value when the component is initialized.

With the default executor (holoscan.gxf.GXFExecutor), the identifier is set to the GXF component ID.

Returns

idint

initialize(self: holoscan.operators._operators.VideoStreamRecorderOp) → None

Initialize the operator.

This method is called only once when the operator is created for the first time, and uses a light-weight initialization.

property name

The name of the operator.

Returns

namestr

property operator_type

The operator type.

holoscan.core.Operator.OperatorType enum representing the type of the operator. The two types currently implemented are native and GXF.

property resources

Resources associated with the operator.

setup(self: holoscan.operators._operators.VideoStreamRecorderOp, spec: holoscan.core._core.OperatorSpec) → None

Define the operator specification.

Parameters

specholoscan.core.OperatorSpec

The operator specification.

property spec

start(self: holoscan.core._core.Operator) → None

Operator start method.

stop(self: holoscan.core._core.Operator) → None

Operator stop method.

class holoscan.operators.VideoStreamReplayerOp

Bases: holoscan.gxf._gxf.GXFOperator

Operator class to replay a video stream from a file.

Attributes

args	The list of arguments associated with the component.
conditions	Conditions associated with the operator.
fragment	The fragment that the operator belongs to.
gxf_cid	The GXF component ID.
gxf_context	The GXF context of the component.
gxf_eid	The GXF entity ID.
gxf_typename	The GXF type name of the resource.
id	The identifier of the component.
name	The name of the operator.
operator_type	The operator type.
resources	Resources associated with the operator.

spec

Methods

OperatorType	Members:
add_arg(*args, **kwargs)	Overloaded function.
compute(self, arg0, arg1, arg2)	Operator compute method.
initialize(self)	Initialize the operator.
setup(self, spec)	Define the operator specification.
start(self)	Operator start method.
stop(self)	Operator stop method.

class OperatorType

Bases: pybind11_builtins.pybind11_object

Members:

NATIVE

GXF

Attributes

name

value

GXF =

NATIVE =

__init__(self: holoscan.core._core.Operator.OperatorType, value: int) → None

property name

property value

__init__(self: holoscan.operators._operators.VideoStreamReplayerOp, fragment: holoscan.core._core.Fragment, directory: str, basename: str, batch_size: int = 1, ignore_corrupted_entities: bool = True, frame_rate: float = 1.0, realtime: bool = True, repeat: bool = False, count: int = 0, name: str = 'format_converter') → None

Operator class to replay a video stream from a file.

Parameters

fragmentFragment

The fragment that the operator belongs to.

directorystr

Directory path for reading files from.

basenamestr

User specified file name without extension.

batch_sizeint, optional

Number of entities to read and publish for one tick.

ignore_corrupted_entitiesbool, optional

If an entity could not be deserialized, it is ignored by default; otherwise a failure is generated.

frame_ratefloat, optional

Frame rate to replay. If zero value is specified, it follows timings in timestamps.

realtimebool, optional

Playback video in realtime, based on frame_rate or timestamps.

repeatbool, optional

Repeat video stream in a loop.

countint, optional

Number of frame counts to playback. If zero value is specified, it is ignored. If the count is less than the number of frames in the video, it would finish early.

namestr, optional

The name of the operator.

add_arg(*args, **kwargs)

Overloaded function.

1. add_arg(self: holoscan.core._core.Component, arg: holoscan.core._core.Arg) -> None

Add an argument to the component.

2. add_arg(self: holoscan.core._core.Component, arg: holoscan.core._core.ArgList) -> None

Add a list of arguments to the component.

property args

The list of arguments associated with the component.

Returns

arglistholoscan.core.ArgList

compute(self: holoscan.core._core.Operator, arg0: holoscan.core._core.InputContext, arg1: holoscan.core._core.OutputContext, arg2: holoscan.core._core.ExecutionContext) → None

Operator compute method. This method defines the primary computation to be executed by the operator.

property conditions

Conditions associated with the operator.

property fragment

The fragment that the operator belongs to.

Returns

nameholoscan.core.Fragment

property gxf_cid

The GXF component ID.

property gxf_context

The GXF context of the component.

property gxf_eid

The GXF entity ID.

property gxf_typename

The GXF type name of the resource.

Returns

str

The GXF type name of the resource

property id

The identifier of the component.

The identifier is initially set to -1, and will become a valid value when the component is initialized.

With the default executor (holoscan.gxf.GXFExecutor), the identifier is set to the GXF component ID.

Returns

idint

initialize(self: holoscan.operators._operators.VideoStreamReplayerOp) → None

Initialize the operator.

This method is called only once when the operator is created for the first time, and uses a light-weight initialization.

property name

The name of the operator.

Returns

namestr

property operator_type

The operator type.

holoscan.core.Operator.OperatorType enum representing the type of the operator. The two types currently implemented are native and GXF.

property resources

Resources associated with the operator.

setup(self: holoscan.operators._operators.VideoStreamReplayerOp, spec: holoscan.core._core.OperatorSpec) → None

Define the operator specification.

Parameters

specholoscan.core.OperatorSpec

The operator specification.

property spec

start(self: holoscan.core._core.Operator) → None

Operator start method.

stop(self: holoscan.core._core.Operator) → None

Operator stop method.