activation.h

Activation functions.

Functions

void nvte_gelu(const NVTETensor input, NVTETensor output, cudaStream_t stream)

Compute GELU activation of the input.

Parameters
  • input[in] Input tensor for GELU activation.

  • output[inout] Output tensor.

  • stream[in] CUDA stream used for the operation.