nemo_gym.server_runtime.supervisor
This page is for version 0.4.0.
For other versions, use one of these documentation indexes:
- Main (default): https://docs.nvidia.com/nemo/gym/main/llms.txt
- 0.7.0: https://docs.nvidia.com/nemo/gym/v0.7.0/llms.txt
- 0.6.0: https://docs.nvidia.com/nemo/gym/v0.6.0/llms.txt
- 0.5.1: https://docs.nvidia.com/nemo/gym/v0.5.1/llms.txt
- 0.5.0: https://docs.nvidia.com/nemo/gym/v0.5.0/llms.txt
- 0.4.0: https://docs.nvidia.com/nemo/gym/v0.4.0/llms.txt
- 0.3.0: https://docs.nvidia.com/nemo/gym/v0.3.0/llms.txt
- 0.2.1: https://docs.nvidia.com/nemo/gym/v0.2.1/llms.txt
Starting the servers of a run and the virtual environments they run in.
This code runs in the process that launches servers, never inside a server, so nothing else in nemo_gym.server_runtime
imports it. server_supervisor starts and stops the servers, server_venv builds their environments,
_locked_env and _prepare_worker are the scripts those environments run, and h2_ping_sidecar runs the
HTTP/2 PING proxy for model endpoints with idle timeouts.
Subpackages
Submodules
Package Contents
Data
_PUBLIC_API
API
