InferenceParams# class nemo_microservices.types.shared_params.InferenceParams Bases: TypedDict max_tokens: int stop: List[str] temperature: float top_k: int top_p: float
