`nemo_microservices.types.data_designer.inference_parameters`#

Module Contents#

Classes#

InferenceParameters

Data#

`Temperature`
`TopP`

API#

class nemo_microservices.types.data_designer.inference_parameters.InferenceParameters(/, **data: Any)#

Bases: nemo_microservices._models.BaseModel

max_parallel_requests: int | None#: None

max_tokens: int | None#: None

temperature: nemo_microservices.types.data_designer.inference_parameters.Temperature | None#: None

timeout: int | None#: None

top_p: nemo_microservices.types.data_designer.inference_parameters.TopP | None#: None

nemo_microservices.types.data_designer.inference_parameters.Temperature: typing_extensions.TypeAlias#: None

nemo_microservices.types.data_designer.inference_parameters.TopP: typing_extensions.TypeAlias#: None