nat.plugins.rag.client

RAG (Retrieval-Augmented Generation) client plugin for the NeMo Agent Toolkit.

This module integrates NVIDIA’s RAG pipeline into the toolkit function group system, exposing search and generate tools that leverage LLMs, embedders, and retrievers for augmented document retrieval and synthesis. It provides a configuration schema and workflow registration for seamless RAG support.

Attributes

logger

Classes

NATRAGConfig

Configuration for NVIDIA RAG Library.

Functions

nat_rag(...)

NVIDIA RAG Library - exposes search and generate tools.

Module Contents

logger: logging.Logger

class NATRAGConfig

Bases: nat.data_models.function.FunctionGroupBaseConfig

Configuration for NVIDIA RAG Library.

Exposes search and generate tools that share a single RAG client.

llm: nat.data_models.component_ref.LLMRef = None

embedder: nat.data_models.component_ref.EmbedderRef = None

retriever: nat.data_models.component_ref.RetrieverRef = None

rag_pipeline: nat.plugins.rag.config.RAGPipelineConfig = None

topic: str | None = None

collection_names: list[str] = None

reranker_top_k: int = None

async nat_rag(

config: NATRAGConfig,

builder: nat.builder.builder.Builder,

) → collections.abc.AsyncGenerator[nat.builder.function.FunctionGroup, None]

NVIDIA RAG Library - exposes search and generate tools.