nemo_automodel.components.speculative.dspark.config

View as Markdown

Module Contents

Functions

NameDescription
build_draft_config-
build_gemma4_draft_configBuild a Gemma4 DSpark draft config from a Gemma4 target’s text sub-config.
get_gemma4_text_configReturn a deep copy of a Gemma4 target’s text sub-config.

Data

TRAIN_ATTN_IMPLEMENTATION

__all__

API

nemo_automodel.components.speculative.dspark.config.build_draft_config(
target_config,
model_args
)
nemo_automodel.components.speculative.dspark.config.build_gemma4_draft_config(
target_config,
model_args
)

Build a Gemma4 DSpark draft config from a Gemma4 target’s text sub-config.

nemo_automodel.components.speculative.dspark.config.get_gemma4_text_config(
target_config
)

Return a deep copy of a Gemma4 target’s text sub-config.

nemo_automodel.components.speculative.dspark.config.TRAIN_ATTN_IMPLEMENTATION = 'flex_attention'
nemo_automodel.components.speculative.dspark.config.__all__ = ['build_draft_config', 'build_gemma4_draft_config', 'get_gemma4_text_config']