nemo_automodel.components.speculative

Speculative decoding and training components.

Subpackages

• nemo_automodel.components.speculative.dflash
  • nemo_automodel.components.speculative.dflash.core
  • nemo_automodel.components.speculative.dflash.target
  • nemo_automodel.components.speculative.dflash.registry
  • nemo_automodel.components.speculative.dflash.draft_qwen3
• nemo_automodel.components.speculative.eagle
  • nemo_automodel.components.speculative.eagle.remote
    • nemo_automodel.components.speculative.eagle.remote.client
    • nemo_automodel.components.speculative.eagle.remote.transport
    • nemo_automodel.components.speculative.eagle.remote.wire
    • nemo_automodel.components.speculative.eagle.remote.protocol
    • nemo_automodel.components.speculative.eagle.remote.server
  • nemo_automodel.components.speculative.eagle.peagle_attention
  • nemo_automodel.components.speculative.eagle.core
  • nemo_automodel.components.speculative.eagle.peagle_data
  • nemo_automodel.components.speculative.eagle.target
  • nemo_automodel.components.speculative.eagle.draft_gpt_oss
  • nemo_automodel.components.speculative.eagle.peagle_trainer
  • nemo_automodel.components.speculative.eagle.draft_llama
  • nemo_automodel.components.speculative.eagle.backend
  • nemo_automodel.components.speculative.eagle.registry
  • nemo_automodel.components.speculative.eagle.target_v12
  • nemo_automodel.components.speculative.eagle.draft_llama_v12
  • nemo_automodel.components.speculative.eagle.peagle_draft
  • nemo_automodel.components.speculative.eagle.core_v12

Submodules

• nemo_automodel.components.speculative.regenerate
• nemo_automodel.components.speculative.serve_target
• nemo_automodel.components.speculative.precompute_eagle3
• nemo_automodel.components.speculative.serve_sglang
• nemo_automodel.components.speculative.bench_sglang