nemo_rl.models.generation.vllm_backend

Module Contents

Classes

VllmInternalWorkerExtension

API

class nemo_rl.models.generation.vllm_backend.VllmInternalWorkerExtension

report_device_id() → str

update_weights_from_ipc_handles(ipc_handles)

Update weights from IPC handles.

Parameters:

ipc_handles (dict) – Dictionary mapping device UUIDs to parameter IPC handles.

Returns:

True if weights were successfully updated.

Return type:

bool