nemo_rl.models.generation.vllm

Submodules

• nemo_rl.models.generation.vllm.vllm_backend
• nemo_rl.models.generation.vllm.draft_utils
• nemo_rl.models.generation.vllm.refit_layout
• nemo_rl.models.generation.vllm.config
• nemo_rl.models.generation.vllm.refit_loader
• nemo_rl.models.generation.vllm.collective_rpc
• nemo_rl.models.generation.vllm.vllm_sparse_refit
• nemo_rl.models.generation.vllm.captured_chat_logprobs
• nemo_rl.models.generation.vllm.vllm_worker_async
• nemo_rl.models.generation.vllm.worker_utils
• nemo_rl.models.generation.vllm.metric_names
• nemo_rl.models.generation.vllm.video_utils
• nemo_rl.models.generation.vllm.vllm_generation
• nemo_rl.models.generation.vllm.vllm_sparse_delta
• nemo_rl.models.generation.vllm.patches
• nemo_rl.models.generation.vllm.utils
• nemo_rl.models.generation.vllm.vllm_worker
• nemo_rl.models.generation.vllm.checkpoint_engine

Package Contents

Data

__all__

API

nemo_rl.models.generation.vllm.__all__

[‘VllmConfig’, ‘VllmGeneration’, ‘VllmGenerationWorker’, ‘VllmAsyncGenerationWorker’]