Pointwise and Reduction#

Pointwise#

The pointwise operation performs an elementwise operation between two tensors. The operation used is controlled by pointwise mode cudnn_frontend::PointwiseMode_t.

C++ API#

std::shared_ptr<Tensor_attributes>
pointwise(std::shared_ptr<Tensor_attributes>,
          Pointwise_attributes);

std::shared_ptr<Tensor_attributes>
pointwise(std::shared_ptr<Tensor_attributes>,
          std::shared_ptr<Tensor_attributes>,
          Pointwise_attributes);

std::shared_ptr<Tensor_attributes>
pointwise(std::shared_ptr<Tensor_attributes>,
          std::shared_ptr<Tensor_attributes>,
          std::shared_ptr<Tensor_attributes>,
          Pointwise_attributes);

The pointwise mode dictates the API among the choices above. Refer to the documentation of cudnn_frontend::PointwiseMode_t for details.

Pointwise attributes is a lightweight structure with setters:

Pointwise_attributes&
set_mode(PointwiseMode_t)

Pointwise_attributes&
set_axis(int64_t)

Pointwise_attributes&
set_relu_lower_clip(float)

Pointwise_attributes&
set_relu_upper_clip(float)

Pointwise_attributes&
set_relu_lower_clip_slope(float)

Pointwise_attributes&
set_name(std::string const&)

Pointwise_attributes&
set_compute_data_type(DataType_t value)

Python API#

  • add

    • a

    • b

    • compute_data_type

    • name

  • bias

    • input

    • bias

    • compute_data_type

    • name

  • rsqrt

    • input

    • compute_data_type

    • name

  • sub

    • a

    • b

    • compute_data_type

    • name

  • mul

    • a

    • b

    • compute_data_type

    • name

  • scale

    • input

    • scale

    • compute_data_type

    • name

  • relu

    • input

    • compute_data_type

    • name

  • gelu

    • input

    • compute_data_type

    • name

  • elu

    • input

    • compute_data_type

    • name

  • cmp_gt

    • input

    • comparison

    • compute_data_type

    • name

Reduction#

The reduction operation reduces an input tensor using an operation controlled by cudnn_frontend::ReductionMode_t. The dimensions in input tensors to reduce are deduced using output tensor dimensions.

C++ API#

std::shared_ptr<Tensor_attributes>
reduction(std::shared_ptr<Tensor_attributes> input, Reduction_attributes);

Reduction attributes is a lightweight structure with setters:

Reduction_attributes&
set_mode(ReductionMode_t)

Reduction_attributes&
set_name(std::string const&)

Reduction_attributes&
set_compute_data_type(DataType_t value)
On this page