GenerationOptionsParam#
- class nemo_microservices.types.GenerationOptionsParam
Bases:
TypedDict- llm_output: bool
Whether the response should also include any custom LLM output.
- llm_params: object
Additional parameters that should be used for the LLM call
- log: GenerationLogOptionsParam
Options for what should be included in the generation log.
- output_vars: bool | List[str]
Whether additional context information should be returned.
When True is specified, the whole context is returned. Otherwise, a list of key names can be specified.
- rails: GenerationRailsOptionsParam
Options for what rails should be used during the generation.