nemo_automodel.components.speculative

This page is for version 0.4.0 · 26.04. For other versions, use one of these documentation indexes: - Nightly (default): https://docs.nvidia.com/nemo/automodel/nightly/llms.txt - Latest: https://docs.nvidia.com/nemo/automodel/latest/llms.txt - 0.5.0 · 26.06: https://docs.nvidia.com/nemo/automodel/v0.5/llms.txt - 0.4.0 · 26.04: https://docs.nvidia.com/nemo/automodel/v0.4/llms.txt

Speculative decoding and training components.

Subpackages

• nemo_automodel.components.speculative.dflash
• nemo_automodel.components.speculative.dspark
• nemo_automodel.components.speculative.eagle
• nemo_automodel.components.speculative.streaming

Submodules

• nemo_automodel.components.speculative.bench_common
• nemo_automodel.components.speculative.bench_sglang
• nemo_automodel.components.speculative.bench_sweep
• nemo_automodel.components.speculative.bench_vllm
• nemo_automodel.components.speculative.decode_eval
• nemo_automodel.components.speculative.precompute_dspark
• nemo_automodel.components.speculative.precompute_eagle3
• nemo_automodel.components.speculative.regen_loop
• nemo_automodel.components.speculative.regenerate
• nemo_automodel.components.speculative.regenerate_vlm
• nemo_automodel.components.speculative.serve_sglang
• nemo_automodel.components.speculative.serve_target
• nemo_automodel.components.speculative.serve_vllm
• nemo_automodel.components.speculative.target_cp