nat.llm.aws_bedrock_llm

Classes

AWSBedrockModelConfig

An AWS Bedrock llm provider to be used with an LLM client.

Functions

aws_bedrock_model(llm_config, builder)

Module Contents

class AWSBedrockModelConfig(/, **data: Any)

Bases: nat.data_models.llm.LLMBaseConfig, nat.data_models.retry_mixin.RetryMixin

An AWS Bedrock llm provider to be used with an LLM client.

Create a new model by parsing and validating input data from keyword arguments.

Raises [ValidationError][pydantic_core.ValidationError] if the input data cannot be validated to form a valid model.

self is explicitly positional-only to allow self as a field name.

model_config

Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].

model_name: str = None

temperature: float = None

max_tokens: int | None = None

context_size: int | None = None

region_name: str | None = None

base_url: str | None = None

credentials_profile_name: str | None = None

async aws_bedrock_model(

llm_config: AWSBedrockModelConfig,

builder: nat.builder.builder.Builder,

)