apply_mxfp8_scale#
-
nvmath.
linalg. advanced. helpers. matmul. apply_mxfp8_scale(x, scale)[source]# Apply MXFP8 block scale factors to tensor
x
.- Parameters:
x – The tensor to which the scaling should be applied.
scale – The block scale factors to apply.
- Returns:
A
float32
tensor with values ofx
with scales applied.
Note
This function is not intended for production usage due to its relatively low performance and high memory consumption. Instead of applying the scales manually using this function, use
result_type
to request non-FP8 output.