NVIDIA Holoscan SDK v0.5.1
v0.5.1

Class InferBase

Derived Types

class InferBase

Base Inference Class.

Subclassed by holoscan::inference::OnnxInfer, holoscan::inference::TrtInfer

Public Functions

inline virtual InferStatus do_inference(std::shared_ptr<DataBuffer> &input_data, std::shared_ptr<DataBuffer> &output_buffer)

Does the Core inference.

Parameters
  • input_data – Input DataBuffer

  • output_buffer – Output DataBuffer, is populated with inferred results

Returns

InferStatus

inline virtual std::vector<int64_t> get_input_dims() const

Get input data dimensions to the model.

Returns

Vector of values as dimension

inline virtual std::vector<int64_t> get_output_dims() const

Get output data dimensions from the model.

Returns

Vector of values as dimension

inline virtual void cleanup()

© Copyright 2022-2023, NVIDIA. Last updated on Jul 28, 2023.