core.tensor_parallel.gtp_api#

Generalized Tensor Parallelism (GTP) public API.

Thin facade over the core implementation in generalized_tensor_parallelism and CUDA-graph lifecycle support in gtp_cuda_graphs. GTP depends on TransformerEngine: if TE is missing or too old the core module imports cleanly but reports HAVE_TE = False, mirrored here as HAVE_GTP = False. Consumers gate every GTP code path behind if HAVE_GTP:, so no core module uses GTP symbols without TE.

Module Contents#

Data#

API#

core.tensor_parallel.gtp_api.__all__#

[‘HAVE_GTP’, ‘GTP_CONFIG’, ‘GTPChain’, ‘GTPEmbeddingWeight’, ‘attach_gtp_to_presharded_module’, ‘cla…