Models
The models module defines configuration objects for model-based generation. ModelProvider specifies connection and authentication details for custom providers. ModelConfig encapsulates model details including the model alias, identifier, and inference parameters. Inference Parameters controls model behavior through settings like temperature, top_p, and max_tokens, with support for both fixed values and distribution-based sampling. The module includes ImageContext for providing image inputs to multimodal models, and ImageInferenceParams for configuring image generation models.
For more information on how they are used, see below: