nemo_microservices.types.generation_options_param#
Module Contents#
Classes#
API#
- class nemo_microservices.types.generation_options_param.GenerationOptionsParam#
Bases:
typing_extensions.TypedDict- llm_output: bool#
None
Whether the response should also include any custom LLM output.
- llm_params: Dict[str, object]#
None
Additional parameters that should be used for the LLM call
- log: nemo_microservices.types.generation_log_options_param.GenerationLogOptionsParam#
None
Options for what should be included in the generation log.
- output_vars: Union[bool, nemo_microservices._types.SequenceNotStr[str]]#
None
Whether additional context information should be returned.
When True is specified, the whole context is returned. Otherwise, a list of key names can be specified.
- rails: nemo_microservices.types.generation_rails_options_param.GenerationRailsOptionsParam#
None
Options for what rails should be used during the generation.