Is this page helpful?

`nemo_microservices.types.data_designer.inference_parameters_param_param`#

Module Contents#

Classes#

InferenceParametersParamParam

Data#

`Temperature`
`TopP`

API#

class nemo_microservices.types.data_designer.inference_parameters_param_param.InferenceParametersParamParam#

Bases: typing_extensions.TypedDict

extra_body: Dict[str, object]#: None

max_parallel_requests: int#: None

max_tokens: int#: None

temperature: Optional[nemo_microservices.types.data_designer.inference_parameters_param_param.Temperature]#: None

timeout: int#: None

top_p: Optional[nemo_microservices.types.data_designer.inference_parameters_param_param.TopP]#: None

nemo_microservices.types.data_designer.inference_parameters_param_param.Temperature: typing_extensions.TypeAlias#: None

nemo_microservices.types.data_designer.inference_parameters_param_param.TopP: typing_extensions.TypeAlias#: None