nemo_eval.utils.base#

Module Contents#

Functions#

check_health

Check the health of the PyTriton (via FAstAPI) and Ray server.

check_endpoint

Check if the endpoint is responsive and ready to accept requests.

Data#

logger

API#

nemo_eval.utils.base.logger#

‘getLogger(…)’

nemo_eval.utils.base.check_health(
health_url: str,
max_retries: int = 600,
retry_interval: int = 2,
) → bool[source]#

Check the health of the PyTriton (via FAstAPI) and Ray server.

nemo_eval.utils.base.check_endpoint(
endpoint_url: str,
endpoint_type: str,
model_name: str,
max_retries: int = 600,
retry_interval: int = 2,
) → bool[source]#

Check if the endpoint is responsive and ready to accept requests.