nat.plugins.langchain.llm#

Attributes#

logger

ModelType

Functions#

_patch_llm_based_on_config(→ ModelType)

aws_bedrock_langchain(llm_config, _builder)

azure_openai_langchain(llm_config, _builder)

nim_langchain(llm_config, _builder)

openai_langchain(llm_config, _builder)

dynamo_langchain(llm_config, _builder)

Create a LangChain ChatOpenAI client for Dynamo with automatic prefix header injection.

litellm_langchain(llm_config, _builder)

huggingface_langchain(llm_config, _builder)

Module Contents#

logger#
ModelType#
_patch_llm_based_on_config(
client: ModelType,
llm_config: nat.data_models.llm.LLMBaseConfig,
) → ModelType#
async aws_bedrock_langchain(
llm_config: nat.llm.aws_bedrock_llm.AWSBedrockModelConfig,
_builder: nat.builder.builder.Builder,
)#
async azure_openai_langchain(
llm_config: nat.llm.azure_openai_llm.AzureOpenAIModelConfig,
_builder: nat.builder.builder.Builder,
)#
async nim_langchain(
llm_config: nat.llm.nim_llm.NIMModelConfig,
_builder: nat.builder.builder.Builder,
)#
async openai_langchain(
llm_config: nat.llm.openai_llm.OpenAIModelConfig,
_builder: nat.builder.builder.Builder,
)#
async dynamo_langchain(
llm_config: nat.llm.dynamo_llm.DynamoModelConfig,
_builder: nat.builder.builder.Builder,
)#

Create a LangChain ChatOpenAI client for Dynamo with automatic prefix header injection.

This client injects Dynamo prefix headers at the HTTP transport level using httpx event hooks, enabling KV cache optimization and request routing.

async litellm_langchain(
llm_config: nat.llm.litellm_llm.LiteLlmModelConfig,
_builder: nat.builder.builder.Builder,
)#
async huggingface_langchain(
llm_config: nat.llm.huggingface_llm.HuggingFaceConfig,
_builder: nat.builder.builder.Builder,
)#