nemo_eval.utils.base

Module Contents

Functions

check_health	Check the health of the PyTriton (via FAstAPI) and Ray server.
check_endpoint	Check if the endpoint is responsive and ready to accept requests.

Data

logger

API

nemo_eval.utils.base.logger

‘getLogger(…)’

nemo_eval.utils.base.check_health(

health_url: str,

max_retries: int = 600,

retry_interval: int = 2,

) → bool

Check the health of the PyTriton (via FAstAPI) and Ray server.

nemo_eval.utils.base.check_endpoint(

endpoint_url: str,

endpoint_type: str,

model_name: str,

max_retries: int = 600,

retry_interval: int = 2,

) → bool

Check if the endpoint is responsive and ready to accept requests.