Is this page helpful?

`nemo_microservices.types.data_designer.inference_parameters_param`#

Module Contents#

Classes#

InferenceParametersParam

Data#

`Temperature`
`TopP`

API#

class nemo_microservices.types.data_designer.inference_parameters_param.InferenceParametersParam(/, **data: typing.Any)#

Bases: nemo_microservices._models.BaseModel

extra_body: Optional[Dict[str, object]]#: None

max_parallel_requests: Optional[int]#: None

max_tokens: Optional[int]#: None

temperature: Optional[nemo_microservices.types.data_designer.inference_parameters_param.Temperature]#: None

timeout: Optional[int]#: None

top_p: Optional[nemo_microservices.types.data_designer.inference_parameters_param.TopP]#: None

nemo_microservices.types.data_designer.inference_parameters_param.Temperature: typing_extensions.TypeAlias#: None

nemo_microservices.types.data_designer.inference_parameters_param.TopP: typing_extensions.TypeAlias#: None