nemo_rl.models.generation.vllm.worker_utils

Module Contents

Functions

find_tokenizer_required_architectures	Return architectures for which vLLM must initialize a tokenizer.
resolve_distributed_executor_backend
resolve_data_parallel_local_rank

Data

TOKENIZER_REQUIRED_ARCHITECTURES

API

nemo_rl.models.generation.vllm.worker_utils.TOKENIZER_REQUIRED_ARCHITECTURES

‘frozenset(…)’

nemo_rl.models.generation.vllm.worker_utils.find_tokenizer_required_architectures(

architectures: collections.abc.Iterable[str] | None,

) → list[str]

Return architectures for which vLLM must initialize a tokenizer.

nemo_rl.models.generation.vllm.worker_utils.resolve_distributed_executor_backend(

tensor_parallel_size: int,

pipeline_parallel_size: int,

expert_parallel_size: int,

) → str | None

nemo_rl.models.generation.vllm.worker_utils.resolve_data_parallel_local_rank(

rank: int,

model_parallel_size: int,

executor_backend: str | None,

) → int