Skip to navigation

Pointwise and Reduction

View as MarkdownOpen in Claude

Pointwise

The pointwise operation performs an elementwise operation on one, two, or three tensors. The operation used is controlled by pointwise mode cudnn_frontend::PointwiseMode_t.

C++ API

std::shared_ptr<Tensor_attributes>
pointwise(std::shared_ptr<Tensor_attributes>,
Pointwise_attributes);
std::shared_ptr<Tensor_attributes>
pointwise(std::shared_ptr<Tensor_attributes>,
std::shared_ptr<Tensor_attributes>,
Pointwise_attributes);
std::shared_ptr<Tensor_attributes>
pointwise(std::shared_ptr<Tensor_attributes>,
std::shared_ptr<Tensor_attributes>,
std::shared_ptr<Tensor_attributes>,
Pointwise_attributes);

The pointwise mode dictates the API among the choices above. Refer to the documentation of cudnn_frontend::PointwiseMode_t for details.

Pointwise attributes is a lightweight structure with setters:

Pointwise_attributes&
set_mode(PointwiseMode_t)
Pointwise_attributes&
set_axis(int64_t)
Pointwise_attributes&
set_relu_lower_clip(float)
Pointwise_attributes&
set_relu_upper_clip(float)
Pointwise_attributes&
set_relu_lower_clip_slope(float)
Pointwise_attributes&
set_name(std::string const&)
Pointwise_attributes&
set_compute_data_type(DataType_t value)

Python API

  • add
    • a
    • b
    • compute_data_type
    • name
  • bias
    • input
    • bias
    • compute_data_type
    • name
  • rsqrt
    • input
    • compute_data_type
    • name
  • sub
    • a
    • b
    • compute_data_type
    • name
  • mul
    • a
    • b
    • compute_data_type
    • name
  • scale
    • input
    • scale
    • compute_data_type
    • name
  • relu
    • input
    • compute_data_type
    • name
  • gelu
    • input
    • compute_data_type
    • name
  • elu
    • input
    • compute_data_type
    • name
  • cmp_gt
    • input
    • comparison
    • compute_data_type
    • name

Reduction

The reduction operation reduces an input tensor using an operation controlled by cudnn_frontend::ReductionMode_t. The dimensions in input tensors to reduce are deduced using output tensor dimensions.

C++ API

std::shared_ptr<Tensor_attributes>
reduction(std::shared_ptr<Tensor_attributes> input, Reduction_attributes);

Reduction attributes is a lightweight structure with setters:

Reduction_attributes&
set_mode(ReductionMode_t)
Reduction_attributes&
set_name(std::string const&)
Reduction_attributes&
set_compute_data_type(DataType_t value)