core.tensor_parallel

Submodules

• core.tensor_parallel.gtp_api
• core.tensor_parallel.data
• core.tensor_parallel.layers
• core.tensor_parallel.inference_layers
• core.tensor_parallel.cross_entropy
• core.tensor_parallel.gtp_cuda_graphs
• core.tensor_parallel.mappings
• core.tensor_parallel.generalized_tensor_parallelism
• core.tensor_parallel.random
• core.tensor_parallel.utils

Package Contents

Data

__all__

API

core.tensor_parallel.__all__

[‘vocab_parallel_cross_entropy’, ‘broadcast_data’, ‘ColumnParallelLinear’, ‘RowParallelLinear’, ‘Voc…