`core.export.export_config`#

Module Contents#

Classes#

Base configuration for Megatron Core Export

API#

class core.export.export_config.ExportConfig#

Base configuration for Megatron Core Export

These parameters control the export setting for trtllm

inference_tp_size: int#: 1

inference_pp_size: int#: 1

use_parallel_embedding: bool#: False

use_embedding_sharing: Optional[bool]#: None

__post_init__()#