bridge.training.utils.flop_utils

Module Contents

Functions

num_floating_point_operations

Return the number of floating point operations

API

bridge.training.utils.flop_utils.num_floating_point_operations(

cfg: megatron.bridge.training.config.ConfigContainer,

batch_size: int = 1,

)

Return the number of floating point operations