core.tensor_parallel.gtp_api#
Generalized Tensor Parallelism (GTP) public API.
Thin re-export of the implementation in
megatron.core.tensor_parallel.generalized_tensor_parallelism (see that module
for the design). GTP depends on TransformerEngine: if TE is missing or too old the
inner module imports cleanly but reports HAVE_TE = False, mirrored here as
HAVE_GTP = False. Consumers gate every GTP code path behind if HAVE_GTP:,
so no core module uses GTP symbols without TE.
Module Contents#
Data#
API#
- core.tensor_parallel.gtp_api.__all__#
[‘HAVE_GTP’, ‘GTPChain’, ‘GTPEmbeddingWeight’, ‘attach_gtp_to_presharded_module’, ‘classify_gtp_rema…