Skip to main content
Ctrl+K
NVIDIA NeMo Agent Toolkit (1.6) - Home NVIDIA NeMo Agent Toolkit (1.6) - Home

NVIDIA NeMo Agent Toolkit (1.6)

  • GitHub
NVIDIA NeMo Agent Toolkit (1.6) - Home NVIDIA NeMo Agent Toolkit (1.6) - Home

NVIDIA NeMo Agent Toolkit (1.6)
  • GitHub

About NeMo Agent Toolkit

  • Overview
  • Release Notes

Get Started

  • Installation
  • Quick Start
  • Tutorials
    • Customize a Workflow
    • Add Tools to a Workflow
    • Create a New Tool and Workflow
    • Build a Demo Agent Workflow Using Cursor Rules

Build Workflows

  • About
  • Workflow Configuration
  • Functions and Function Groups
    • Functions
    • Function Groups
  • LLMs
    • Using Local LLMs
  • Embedders
  • Retrievers
  • Memory
  • Object Stores
  • MCP
  • A2A
  • Advanced
    • Interactive Workflows
    • Middleware

Run Workflows

  • About
  • Existing Agents
    • LangGraph
  • Observe Workflows
  • API Server and User Interface
  • MCP Server
  • FastMCP Server
  • A2A Server

Improve Workflows

  • About
  • Evaluate Workflows
  • Profiling and Performance Monitoring
  • Optimizer Guide
  • Sizing Calculator
  • Test Time Compute
  • Finetuning
    • Concepts
    • OpenPipe ART
    • DPO With NeMo Customizer

Components

  • Agents
    • ReAct Agent
      • Configure ReAct Agent
    • Reasoning Agent
      • Configure Reasoning Agent
    • ReWOO Agent
      • Configure ReWOO Agent
    • Responses API and Agent
      • Configure Responses API and Agent
    • Router Agent
      • Configure Router Agent
    • Parallel Executor
      • Configure Parallel Executor
    • Sequential Executor
      • Configure Sequential Executor
    • Tool Calling Agent
      • Configure Tool Calling Agent
    • Automatic Memory Wrapper
      • Configure Automatic Memory Wrapper Agent
  • Functions
    • Code Execution
    • Text-to-SQL with Vanna
  • Authentication
    • User Identity Resolution
    • Authentication Provider API
    • MCP Authentication
      • Service Account Authentication
      • Secure Token Storage
    • A2A Authentication
  • Integrations
    • Framework Integrations
    • Agent-to-Agent Protocol (A2A)
    • AWS Bedrock
  • Sharing Components

Extend

  • Plugins
  • Custom Components
    • Functions
    • Function Groups
    • Writing Per-User Functions
    • Authentication Provider
    • LLM Provider
    • Retriever
    • Evaluator
    • Dataset Loader
    • MCP Server Worker
    • Memory Provider
    • Object Store Provider
    • Telemetry Exporter
    • Optimizer
    • Gated Fields
    • Finetuning Harness
  • Testing
    • Adding Unit Tests for Tools
    • Test With nat_test_llm

Reference

  • Python API
    • nat
      • nat.atif
        • nat.atif.agent
        • nat.atif.atif_step_extra
        • nat.atif.content
        • nat.atif.final_metrics
        • nat.atif.metrics
        • nat.atif.observation
        • nat.atif.observation_result
        • nat.atif.scripts
          • nat.atif.scripts.generate_atif_trajectory
        • nat.atif.step
        • nat.atif.subagent_trajectory_ref
        • nat.atif.tool_call
        • nat.atif.trajectory
      • nat.authentication
        • nat.authentication.api_key
          • nat.authentication.api_key.api_key_auth_provider
          • nat.authentication.api_key.api_key_auth_provider_config
          • nat.authentication.api_key.register
        • nat.authentication.credential_validator
          • nat.authentication.credential_validator.bearer_token_validator
        • nat.authentication.exceptions
          • nat.authentication.exceptions.api_key_exceptions
        • nat.authentication.http_basic_auth
          • nat.authentication.http_basic_auth.http_basic_auth_provider
          • nat.authentication.http_basic_auth.register
        • nat.authentication.interfaces
        • nat.authentication.jwt_utils
        • nat.authentication.oauth2
          • nat.authentication.oauth2.oauth2_auth_code_flow_provider
          • nat.authentication.oauth2.oauth2_auth_code_flow_provider_config
          • nat.authentication.oauth2.oauth2_resource_server_config
          • nat.authentication.oauth2.register
        • nat.authentication.register
        • nat.authentication.token_storage
      • nat.builder
        • nat.builder.builder
        • nat.builder.child_builder
        • nat.builder.component_utils
        • nat.builder.context
        • nat.builder.dataset_loader
        • nat.builder.embedder
        • nat.builder.evaluator
        • nat.builder.framework_enum
        • nat.builder.front_end
        • nat.builder.function
        • nat.builder.function_base
        • nat.builder.function_info
        • nat.builder.intermediate_step_manager
        • nat.builder.llm
        • nat.builder.per_user_workflow_builder
        • nat.builder.retriever
        • nat.builder.runtime_event_subscriber
        • nat.builder.sync_builder
        • nat.builder.user_interaction_manager
        • nat.builder.workflow
        • nat.builder.workflow_builder
      • nat.cli
        • nat.cli.cli_utils
          • nat.cli.cli_utils.config_override
          • nat.cli.cli_utils.validation
        • nat.cli.commands
          • nat.cli.commands.configure
            • nat.cli.commands.configure.channel
            • nat.cli.commands.configure.configure
          • nat.cli.commands.finetune
          • nat.cli.commands.info
            • nat.cli.commands.info.info
            • nat.cli.commands.info.list_channels
            • nat.cli.commands.info.list_components
          • nat.cli.commands.object_store
            • nat.cli.commands.object_store.object_store
          • nat.cli.commands.registry
            • nat.cli.commands.registry.publish
            • nat.cli.commands.registry.pull
            • nat.cli.commands.registry.registry
            • nat.cli.commands.registry.remove
            • nat.cli.commands.registry.search
          • nat.cli.commands.start
          • nat.cli.commands.uninstall
          • nat.cli.commands.validate
          • nat.cli.commands.workflow
            • nat.cli.commands.workflow.workflow
            • nat.cli.commands.workflow.workflow_commands
        • nat.cli.entrypoint
        • nat.cli.main
        • nat.cli.plugin_loader
        • nat.cli.register_workflow
        • nat.cli.type_registry
      • nat.data_models
        • nat.data_models.agent
        • nat.data_models.api_server
        • nat.data_models.authentication
        • nat.data_models.common
        • nat.data_models.component
        • nat.data_models.component_ref
        • nat.data_models.config
        • nat.data_models.dataset_handler
        • nat.data_models.discovery_metadata
        • nat.data_models.embedder
        • nat.data_models.evaluate
        • nat.data_models.evaluate_config
        • nat.data_models.evaluate_runtime
        • nat.data_models.evaluator
        • nat.data_models.finetuning
        • nat.data_models.front_end
        • nat.data_models.function
        • nat.data_models.function_dependencies
        • nat.data_models.gated_field_mixin
        • nat.data_models.interactive
        • nat.data_models.interactive_http
        • nat.data_models.intermediate_step
        • nat.data_models.invocation_node
        • nat.data_models.llm
        • nat.data_models.logging
        • nat.data_models.memory
        • nat.data_models.middleware
        • nat.data_models.object_store
        • nat.data_models.openai_mcp
        • nat.data_models.optimizable
        • nat.data_models.optimizer
        • nat.data_models.profiler
        • nat.data_models.profiler_callback
        • nat.data_models.registry_handler
        • nat.data_models.retriever
        • nat.data_models.retry_mixin
        • nat.data_models.runtime_enum
        • nat.data_models.span
        • nat.data_models.ssl_verification_mixin
        • nat.data_models.step_adaptor
        • nat.data_models.streaming
        • nat.data_models.swe_bench_model
        • nat.data_models.telemetry_exporter
        • nat.data_models.thinking_mixin
        • nat.data_models.token_usage
        • nat.data_models.ttc_strategy
        • nat.data_models.user_info
      • nat.embedder
        • nat.embedder.azure_openai_embedder
        • nat.embedder.huggingface_embedder
        • nat.embedder.nim_embedder
        • nat.embedder.openai_embedder
        • nat.embedder.register
      • nat.eval
      • nat.experimental
        • nat.experimental.decorators
          • nat.experimental.decorators.experimental_warning_decorator
        • nat.experimental.test_time_compute
          • nat.experimental.test_time_compute.editing
            • nat.experimental.test_time_compute.editing.iterative_plan_refinement_editor
            • nat.experimental.test_time_compute.editing.llm_as_a_judge_editor
            • nat.experimental.test_time_compute.editing.motivation_aware_summarization
          • nat.experimental.test_time_compute.functions
            • nat.experimental.test_time_compute.functions.execute_score_select_function
            • nat.experimental.test_time_compute.functions.multi_llm_judge_function
            • nat.experimental.test_time_compute.functions.plan_select_execute_function
            • nat.experimental.test_time_compute.functions.ttc_tool_orchestration_function
            • nat.experimental.test_time_compute.functions.ttc_tool_wrapper_function
          • nat.experimental.test_time_compute.models
            • nat.experimental.test_time_compute.models.editor_config
            • nat.experimental.test_time_compute.models.scoring_config
            • nat.experimental.test_time_compute.models.search_config
            • nat.experimental.test_time_compute.models.selection_config
            • nat.experimental.test_time_compute.models.stage_enums
            • nat.experimental.test_time_compute.models.strategy_base
            • nat.experimental.test_time_compute.models.tool_use_config
            • nat.experimental.test_time_compute.models.ttc_item
          • nat.experimental.test_time_compute.register
          • nat.experimental.test_time_compute.scoring
            • nat.experimental.test_time_compute.scoring.llm_based_agent_scorer
            • nat.experimental.test_time_compute.scoring.llm_based_plan_scorer
            • nat.experimental.test_time_compute.scoring.motivation_aware_scorer
          • nat.experimental.test_time_compute.search
            • nat.experimental.test_time_compute.search.multi_llm_generation
            • nat.experimental.test_time_compute.search.multi_llm_planner
            • nat.experimental.test_time_compute.search.multi_query_retrieval_search
            • nat.experimental.test_time_compute.search.single_shot_multi_plan_planner
          • nat.experimental.test_time_compute.selection
            • nat.experimental.test_time_compute.selection.best_of_n_selector
            • nat.experimental.test_time_compute.selection.llm_based_agent_output_selector
            • nat.experimental.test_time_compute.selection.llm_based_output_merging_selector
            • nat.experimental.test_time_compute.selection.llm_based_plan_selector
            • nat.experimental.test_time_compute.selection.llm_judge_selection
            • nat.experimental.test_time_compute.selection.threshold_selector
      • nat.finetuning
        • nat.finetuning.finetuning_runtime
        • nat.finetuning.interfaces
          • nat.finetuning.interfaces.finetuning_runner
          • nat.finetuning.interfaces.trainer_adapter
          • nat.finetuning.interfaces.trajectory_builder
        • nat.finetuning.utils
          • nat.finetuning.utils.parsers
            • nat.finetuning.utils.parsers.base_parser
            • nat.finetuning.utils.parsers.common
      • nat.front_ends
        • nat.front_ends.console
          • nat.front_ends.console.authentication_flow_handler
          • nat.front_ends.console.console_front_end_config
          • nat.front_ends.console.console_front_end_plugin
          • nat.front_ends.console.register
        • nat.front_ends.cron
        • nat.front_ends.fastapi
          • nat.front_ends.fastapi.async_jobs
            • nat.front_ends.fastapi.async_jobs.async_job
            • nat.front_ends.fastapi.async_jobs.dask_client_mixin
            • nat.front_ends.fastapi.async_jobs.job_store
          • nat.front_ends.fastapi.auth_flow_handlers
            • nat.front_ends.fastapi.auth_flow_handlers.http_flow_handler
            • nat.front_ends.fastapi.auth_flow_handlers.websocket_flow_handler
          • nat.front_ends.fastapi.execution_store
          • nat.front_ends.fastapi.fastapi_front_end_config
          • nat.front_ends.fastapi.fastapi_front_end_controller
          • nat.front_ends.fastapi.fastapi_front_end_plugin
          • nat.front_ends.fastapi.fastapi_front_end_plugin_worker
          • nat.front_ends.fastapi.html_snippets
            • nat.front_ends.fastapi.html_snippets.auth_code_grant_success
          • nat.front_ends.fastapi.http_interactive_runner
          • nat.front_ends.fastapi.intermediate_steps_subscriber
          • nat.front_ends.fastapi.main
          • nat.front_ends.fastapi.message_handler
          • nat.front_ends.fastapi.message_validator
          • nat.front_ends.fastapi.register
          • nat.front_ends.fastapi.response_helpers
          • nat.front_ends.fastapi.routes
            • nat.front_ends.fastapi.routes.async_generation
            • nat.front_ends.fastapi.routes.auth
            • nat.front_ends.fastapi.routes.chat
            • nat.front_ends.fastapi.routes.common_utils
            • nat.front_ends.fastapi.routes.execution
            • nat.front_ends.fastapi.routes.generate
            • nat.front_ends.fastapi.routes.health
            • nat.front_ends.fastapi.routes.monitor
            • nat.front_ends.fastapi.routes.static
            • nat.front_ends.fastapi.routes.v1_chat_completions
            • nat.front_ends.fastapi.routes.websocket
          • nat.front_ends.fastapi.step_adaptor
          • nat.front_ends.fastapi.utils
        • nat.front_ends.register
        • nat.front_ends.simple_base
          • nat.front_ends.simple_base.simple_front_end_plugin_base
      • nat.llm
        • nat.llm.aws_bedrock_llm
        • nat.llm.azure_openai_llm
        • nat.llm.dynamo_llm
        • nat.llm.huggingface_inference_llm
        • nat.llm.huggingface_llm
        • nat.llm.litellm_llm
        • nat.llm.nim_llm
        • nat.llm.openai_llm
        • nat.llm.prediction_context
        • nat.llm.register
        • nat.llm.utils
          • nat.llm.utils.constants
          • nat.llm.utils.env_config_value
          • nat.llm.utils.error
          • nat.llm.utils.hooks
          • nat.llm.utils.http_client
          • nat.llm.utils.thinking
      • nat.memory
        • nat.memory.interfaces
        • nat.memory.models
      • nat.meta
      • nat.middleware
        • nat.middleware.cache
          • nat.middleware.cache.cache_middleware
          • nat.middleware.cache.cache_middleware_config
          • nat.middleware.cache.register
        • nat.middleware.common
        • nat.middleware.defense
          • nat.middleware.defense.defense_middleware
          • nat.middleware.defense.defense_middleware_content_guard
          • nat.middleware.defense.defense_middleware_data_models
          • nat.middleware.defense.defense_middleware_output_verifier
          • nat.middleware.defense.defense_middleware_pii
          • nat.middleware.defense.defense_middleware_pre_tool_verifier
          • nat.middleware.defense.register
        • nat.middleware.dynamic
          • nat.middleware.dynamic.dynamic_function_middleware
          • nat.middleware.dynamic.dynamic_middleware_config
          • nat.middleware.dynamic.register
        • nat.middleware.function_middleware
        • nat.middleware.logging
          • nat.middleware.logging.logging_middleware
          • nat.middleware.logging.logging_middleware_config
          • nat.middleware.logging.register
        • nat.middleware.middleware
        • nat.middleware.red_teaming
          • nat.middleware.red_teaming.red_teaming_middleware
          • nat.middleware.red_teaming.red_teaming_middleware_config
          • nat.middleware.red_teaming.register
        • nat.middleware.register
        • nat.middleware.timeout
          • nat.middleware.timeout.register
          • nat.middleware.timeout.timeout_middleware
          • nat.middleware.timeout.timeout_middleware_config
        • nat.middleware.utils
          • nat.middleware.utils.workflow_inventory
      • nat.object_store
        • nat.object_store.in_memory_object_store
        • nat.object_store.interfaces
        • nat.object_store.models
        • nat.object_store.register
      • nat.observability
        • nat.observability.exporter
          • nat.observability.exporter.base_exporter
          • nat.observability.exporter.exporter
          • nat.observability.exporter.file_exporter
          • nat.observability.exporter.processing_exporter
          • nat.observability.exporter.raw_exporter
          • nat.observability.exporter.span_exporter
        • nat.observability.exporter_manager
        • nat.observability.mixin
          • nat.observability.mixin.batch_config_mixin
          • nat.observability.mixin.collector_config_mixin
          • nat.observability.mixin.file_mixin
          • nat.observability.mixin.file_mode
          • nat.observability.mixin.redaction_config_mixin
          • nat.observability.mixin.resource_conflict_mixin
          • nat.observability.mixin.serialize_mixin
          • nat.observability.mixin.tagging_config_mixin
          • nat.observability.mixin.type_introspection_mixin
        • nat.observability.processor
          • nat.observability.processor.batching_processor
          • nat.observability.processor.callback_processor
          • nat.observability.processor.falsy_batch_filter_processor
          • nat.observability.processor.intermediate_step_serializer
          • nat.observability.processor.processor
          • nat.observability.processor.processor_factory
          • nat.observability.processor.redaction
            • nat.observability.processor.redaction.contextual_redaction_processor
            • nat.observability.processor.redaction.contextual_span_redaction_processor
            • nat.observability.processor.redaction.redaction_processor
            • nat.observability.processor.redaction.span_header_redaction_processor
          • nat.observability.processor.span_tagging_processor
        • nat.observability.register
        • nat.observability.utils
          • nat.observability.utils.dict_utils
          • nat.observability.utils.time_utils
          • nat.observability.utils.tracing_utils
      • nat.parameter_optimization
        • nat.parameter_optimization.eval_runtime_loader
      • nat.plugins
        • nat.plugins.a2a
          • nat.plugins.a2a.auth
            • nat.plugins.a2a.auth.credential_service
          • nat.plugins.a2a.cli
            • nat.plugins.a2a.cli.commands
          • nat.plugins.a2a.client
            • nat.plugins.a2a.client.client_base
            • nat.plugins.a2a.client.client_config
            • nat.plugins.a2a.client.client_impl
          • nat.plugins.a2a.register
          • nat.plugins.a2a.server
            • nat.plugins.a2a.server.agent_executor_adapter
            • nat.plugins.a2a.server.front_end_config
            • nat.plugins.a2a.server.front_end_plugin
            • nat.plugins.a2a.server.front_end_plugin_worker
            • nat.plugins.a2a.server.oauth_middleware
            • nat.plugins.a2a.server.register_frontend
        • nat.plugins.adk
          • nat.plugins.adk.adk_parser
          • nat.plugins.adk.callback_handler
          • nat.plugins.adk.llm
          • nat.plugins.adk.register
          • nat.plugins.adk.tool_wrapper
        • nat.plugins.agno
          • nat.plugins.agno.callback_handler
          • nat.plugins.agno.llm
          • nat.plugins.agno.register
          • nat.plugins.agno.tool_wrapper
          • nat.plugins.agno.tools
            • nat.plugins.agno.tools.register
            • nat.plugins.agno.tools.serp_api_tool
        • nat.plugins.autogen
          • nat.plugins.autogen.callback_handler
          • nat.plugins.autogen.llm
          • nat.plugins.autogen.register
          • nat.plugins.autogen.tool_wrapper
        • nat.plugins.config_optimizer
          • nat.plugins.config_optimizer.cli
            • nat.plugins.config_optimizer.cli.commands
            • nat.plugins.config_optimizer.cli.optimize
          • nat.plugins.config_optimizer.eval_runtime_loader
          • nat.plugins.config_optimizer.optimizable_utils
          • nat.plugins.config_optimizer.optimizer_runtime
          • nat.plugins.config_optimizer.parameters
            • nat.plugins.config_optimizer.parameters.base
            • nat.plugins.config_optimizer.parameters.optimizer
            • nat.plugins.config_optimizer.parameters.pareto_visualizer
            • nat.plugins.config_optimizer.parameters.selection
          • nat.plugins.config_optimizer.prompts
            • nat.plugins.config_optimizer.prompts.base
            • nat.plugins.config_optimizer.prompts.ga_individual
            • nat.plugins.config_optimizer.prompts.ga_prompt_optimizer
            • nat.plugins.config_optimizer.prompts.oracle_feedback
          • nat.plugins.config_optimizer.register
          • nat.plugins.config_optimizer.update_helpers
        • nat.plugins.crewai
          • nat.plugins.crewai.crewai_callback_handler
          • nat.plugins.crewai.llm
          • nat.plugins.crewai.register
          • nat.plugins.crewai.tool_wrapper
        • nat.plugins.customizer
          • nat.plugins.customizer.dpo
            • nat.plugins.customizer.dpo.config
            • nat.plugins.customizer.dpo.register
            • nat.plugins.customizer.dpo.trainer
            • nat.plugins.customizer.dpo.trainer_adapter
            • nat.plugins.customizer.dpo.trajectory_builder
          • nat.plugins.customizer.register
        • nat.plugins.eval
          • nat.plugins.eval.cli
            • nat.plugins.eval.cli.commands
            • nat.plugins.eval.cli.evaluate
          • nat.plugins.eval.data_models
            • nat.plugins.eval.data_models.evaluator_io
          • nat.plugins.eval.dataset_handler
            • nat.plugins.eval.dataset_handler.dataset_downloader
            • nat.plugins.eval.dataset_handler.dataset_filter
            • nat.plugins.eval.dataset_handler.dataset_handler
          • nat.plugins.eval.dataset_loader
            • nat.plugins.eval.dataset_loader.register
          • nat.plugins.eval.eval_callbacks
          • nat.plugins.eval.evaluator
            • nat.plugins.eval.evaluator.atif_base_evaluator
            • nat.plugins.eval.evaluator.atif_evaluator
            • nat.plugins.eval.evaluator.base_evaluator
            • nat.plugins.eval.evaluator.evaluator_model
          • nat.plugins.eval.exporters
            • nat.plugins.eval.exporters.file_eval_callback
          • nat.plugins.eval.fastapi
            • nat.plugins.eval.fastapi.routes
          • nat.plugins.eval.register
          • nat.plugins.eval.runners
            • nat.plugins.eval.runners.config
            • nat.plugins.eval.runners.multi_eval_runner
          • nat.plugins.eval.runtime
            • nat.plugins.eval.runtime.atif_adapter
            • nat.plugins.eval.runtime.builder
            • nat.plugins.eval.runtime.eval_harness
            • nat.plugins.eval.runtime.evaluate
            • nat.plugins.eval.runtime.llm_validator
            • nat.plugins.eval.runtime.remote_workflow
          • nat.plugins.eval.utils
            • nat.plugins.eval.utils.intermediate_step_adapter
            • nat.plugins.eval.utils.output_uploader
            • nat.plugins.eval.utils.tqdm_position_registry
        • nat.plugins.fastmcp
          • nat.plugins.fastmcp.cli
            • nat.plugins.fastmcp.cli.commands
            • nat.plugins.fastmcp.cli.utils
          • nat.plugins.fastmcp.server
            • nat.plugins.fastmcp.server.front_end_config
            • nat.plugins.fastmcp.server.front_end_plugin
            • nat.plugins.fastmcp.server.front_end_plugin_worker
            • nat.plugins.fastmcp.server.register_frontend
            • nat.plugins.fastmcp.server.tool_converter
        • nat.plugins.langchain
          • nat.plugins.langchain.agent
            • nat.plugins.langchain.agent.auto_memory_wrapper
            • nat.plugins.langchain.agent.base
            • nat.plugins.langchain.agent.dual_node
            • nat.plugins.langchain.agent.prompt_optimizer
            • nat.plugins.langchain.agent.react_agent
            • nat.plugins.langchain.agent.reasoning_agent
            • nat.plugins.langchain.agent.register
            • nat.plugins.langchain.agent.responses_api_agent
            • nat.plugins.langchain.agent.rewoo_agent
            • nat.plugins.langchain.agent.tool_calling_agent
          • nat.plugins.langchain.callback_handler
          • nat.plugins.langchain.control_flow
            • nat.plugins.langchain.control_flow.parallel_executor
            • nat.plugins.langchain.control_flow.register
            • nat.plugins.langchain.control_flow.router_agent
            • nat.plugins.langchain.control_flow.sequential_executor
          • nat.plugins.langchain.dataset_loader
            • nat.plugins.langchain.dataset_loader.langsmith
            • nat.plugins.langchain.dataset_loader.register
          • nat.plugins.langchain.embedder
          • nat.plugins.langchain.eval
            • nat.plugins.langchain.eval.langsmith_custom_evaluator
            • nat.plugins.langchain.eval.langsmith_evaluator
            • nat.plugins.langchain.eval.langsmith_evaluator_adapter
            • nat.plugins.langchain.eval.langsmith_judge
            • nat.plugins.langchain.eval.register
            • nat.plugins.langchain.eval.trajectory_evaluator
            • nat.plugins.langchain.eval.tunable_rag_evaluator
            • nat.plugins.langchain.eval.utils
          • nat.plugins.langchain.langchain_parser
          • nat.plugins.langchain.langgraph_workflow
          • nat.plugins.langchain.langsmith
            • nat.plugins.langchain.langsmith.langsmith_evaluation_callback
            • nat.plugins.langchain.langsmith.langsmith_optimization_callback
            • nat.plugins.langchain.langsmith.register
          • nat.plugins.langchain.llm
          • nat.plugins.langchain.register
          • nat.plugins.langchain.retriever
          • nat.plugins.langchain.tool_wrapper
          • nat.plugins.langchain.tools
            • nat.plugins.langchain.tools.code_generation_tool
            • nat.plugins.langchain.tools.register
            • nat.plugins.langchain.tools.tavily_internet_search
            • nat.plugins.langchain.tools.wikipedia_search
        • nat.plugins.llama_index
          • nat.plugins.llama_index.callback_handler
          • nat.plugins.llama_index.embedder
          • nat.plugins.llama_index.llama_index_parser
          • nat.plugins.llama_index.llm
          • nat.plugins.llama_index.register
          • nat.plugins.llama_index.tool_wrapper
        • nat.plugins.mcp
          • nat.plugins.mcp.auth
            • nat.plugins.mcp.auth.auth_flow_handler
            • nat.plugins.mcp.auth.auth_provider
            • nat.plugins.mcp.auth.auth_provider_config
            • nat.plugins.mcp.auth.register
            • nat.plugins.mcp.auth.service_account
          • nat.plugins.mcp.cli
            • nat.plugins.mcp.cli.commands
          • nat.plugins.mcp.client
            • nat.plugins.mcp.client.client_base
            • nat.plugins.mcp.client.client_config
            • nat.plugins.mcp.client.client_impl
            • nat.plugins.mcp.client.fastapi_routes
          • nat.plugins.mcp.exception_handler
          • nat.plugins.mcp.exceptions
          • nat.plugins.mcp.register
          • nat.plugins.mcp.server
            • nat.plugins.mcp.server.front_end_config
            • nat.plugins.mcp.server.front_end_plugin
            • nat.plugins.mcp.server.front_end_plugin_worker
            • nat.plugins.mcp.server.introspection_token_verifier
            • nat.plugins.mcp.server.memory_profiler
            • nat.plugins.mcp.server.register_frontend
            • nat.plugins.mcp.server.tool_converter
          • nat.plugins.mcp.utils
        • nat.plugins.mem0ai
          • nat.plugins.mem0ai.mem0_editor
          • nat.plugins.mem0ai.memory
          • nat.plugins.mem0ai.register
        • nat.plugins.memmachine
          • nat.plugins.memmachine.memmachine_editor
          • nat.plugins.memmachine.memory
          • nat.plugins.memmachine.register
        • nat.plugins.mysql
          • nat.plugins.mysql.mysql_object_store
          • nat.plugins.mysql.object_store
          • nat.plugins.mysql.register
        • nat.plugins.openpipe
          • nat.plugins.openpipe.config
          • nat.plugins.openpipe.register
          • nat.plugins.openpipe.trainer
          • nat.plugins.openpipe.trainer_adapter
          • nat.plugins.openpipe.trajectory_builder
        • nat.plugins.opentelemetry
          • nat.plugins.opentelemetry.mixin
            • nat.plugins.opentelemetry.mixin.otlp_span_exporter_mixin
          • nat.plugins.opentelemetry.otel_span
          • nat.plugins.opentelemetry.otel_span_exporter
          • nat.plugins.opentelemetry.otlp_span_adapter_exporter
          • nat.plugins.opentelemetry.otlp_span_redaction_adapter_exporter
          • nat.plugins.opentelemetry.register
          • nat.plugins.opentelemetry.span_converter
        • nat.plugins.phoenix
          • nat.plugins.phoenix.mixin
            • nat.plugins.phoenix.mixin.phoenix_mixin
          • nat.plugins.phoenix.phoenix_exporter
          • nat.plugins.phoenix.register
        • nat.plugins.profiler
          • nat.plugins.profiler.calc
            • nat.plugins.profiler.calc.calc_runner
            • nat.plugins.profiler.calc.calculations
            • nat.plugins.profiler.calc.data_models
            • nat.plugins.profiler.calc.plot
          • nat.plugins.profiler.callbacks
            • nat.plugins.profiler.callbacks.base_callback_class
            • nat.plugins.profiler.callbacks.token_usage_base_model
          • nat.plugins.profiler.cli
            • nat.plugins.profiler.cli.commands
            • nat.plugins.profiler.cli.sizing
          • nat.plugins.profiler.data_frame_row
          • nat.plugins.profiler.data_models
          • nat.plugins.profiler.decorators
            • nat.plugins.profiler.decorators.framework_wrapper
            • nat.plugins.profiler.decorators.function_tracking
            • nat.plugins.profiler.decorators.latency
          • nat.plugins.profiler.forecasting
            • nat.plugins.profiler.forecasting.config
            • nat.plugins.profiler.forecasting.model_trainer
            • nat.plugins.profiler.forecasting.models
          • nat.plugins.profiler.inference_metrics_model
          • nat.plugins.profiler.inference_optimization
            • nat.plugins.profiler.inference_optimization.bottleneck_analysis
            • nat.plugins.profiler.inference_optimization.data_models
            • nat.plugins.profiler.inference_optimization.dynamo_metrics
            • nat.plugins.profiler.inference_optimization.experimental
            • nat.plugins.profiler.inference_optimization.llm_metrics
            • nat.plugins.profiler.inference_optimization.prompt_caching
            • nat.plugins.profiler.inference_optimization.token_uniqueness
            • nat.plugins.profiler.inference_optimization.workflow_runtimes
          • nat.plugins.profiler.intermediate_property_adapter
          • nat.plugins.profiler.profile_runner
          • nat.plugins.profiler.register
          • nat.plugins.profiler.runtime_evaluator
            • nat.plugins.profiler.runtime_evaluator.atif_evaluate
            • nat.plugins.profiler.runtime_evaluator.evaluate
            • nat.plugins.profiler.runtime_evaluator.register
          • nat.plugins.profiler.utils
        • nat.plugins.rag
          • nat.plugins.rag.client
          • nat.plugins.rag.config
          • nat.plugins.rag.models
          • nat.plugins.rag.register
        • nat.plugins.ragaai
          • nat.plugins.ragaai.mixin
            • nat.plugins.ragaai.mixin.ragaai_catalyst_mixin
          • nat.plugins.ragaai.ragaai_catalyst_exporter
          • nat.plugins.ragaai.register
        • nat.plugins.ragas
          • nat.plugins.ragas.rag_evaluator
            • nat.plugins.ragas.rag_evaluator.atif_evaluate
            • nat.plugins.ragas.rag_evaluator.data_models
            • nat.plugins.ragas.rag_evaluator.evaluate
            • nat.plugins.ragas.rag_evaluator.llm_adapter
            • nat.plugins.ragas.rag_evaluator.register
            • nat.plugins.ragas.rag_evaluator.utils
          • nat.plugins.ragas.register
        • nat.plugins.redis
          • nat.plugins.redis.memory
          • nat.plugins.redis.object_store
          • nat.plugins.redis.redis_editor
          • nat.plugins.redis.redis_object_store
          • nat.plugins.redis.register
          • nat.plugins.redis.schema
        • nat.plugins.s3
          • nat.plugins.s3.object_store
          • nat.plugins.s3.register
          • nat.plugins.s3.s3_object_store
        • nat.plugins.security
          • nat.plugins.security.cli
            • nat.plugins.security.cli.commands
            • nat.plugins.security.cli.red_teaming
          • nat.plugins.security.eval
            • nat.plugins.security.eval.red_teaming_evaluator
            • nat.plugins.security.eval.runners
          • nat.plugins.security.register
        • nat.plugins.semantic_kernel
          • nat.plugins.semantic_kernel.callback_handler
          • nat.plugins.semantic_kernel.llm
          • nat.plugins.semantic_kernel.register
          • nat.plugins.semantic_kernel.tool_wrapper
        • nat.plugins.strands
          • nat.plugins.strands.callback_handler
          • nat.plugins.strands.llm
          • nat.plugins.strands.register
          • nat.plugins.strands.tool_wrapper
        • nat.plugins.vanna
          • nat.plugins.vanna.db_utils
          • nat.plugins.vanna.execute_db_query
          • nat.plugins.vanna.register
          • nat.plugins.vanna.text2sql
          • nat.plugins.vanna.training_db_schema
          • nat.plugins.vanna.vanna_utils
        • nat.plugins.weave
          • nat.plugins.weave.fastapi_plugin_worker
          • nat.plugins.weave.register
          • nat.plugins.weave.weave_eval_callback
          • nat.plugins.weave.weave_exporter
        • nat.plugins.zep_cloud
          • nat.plugins.zep_cloud.memory
          • nat.plugins.zep_cloud.register
          • nat.plugins.zep_cloud.zep_editor
      • nat.profiler
        • nat.profiler.callbacks
        • nat.profiler.forecasting
        • nat.profiler.inference_optimization
          • nat.profiler.inference_optimization.bottleneck_analysis
          • nat.profiler.inference_optimization.experimental
        • nat.profiler.prediction_trie
          • nat.profiler.prediction_trie.data_models
          • nat.profiler.prediction_trie.metrics_accumulator
          • nat.profiler.prediction_trie.serialization
          • nat.profiler.prediction_trie.trie_builder
          • nat.profiler.prediction_trie.trie_lookup
      • nat.registry_handlers
        • nat.registry_handlers.local
          • nat.registry_handlers.local.local_handler
          • nat.registry_handlers.local.register_local
        • nat.registry_handlers.metadata_factory
        • nat.registry_handlers.package_utils
        • nat.registry_handlers.pypi
          • nat.registry_handlers.pypi.pypi_handler
          • nat.registry_handlers.pypi.register_pypi
        • nat.registry_handlers.register
        • nat.registry_handlers.registry_handler_base
        • nat.registry_handlers.rest
          • nat.registry_handlers.rest.register_rest
          • nat.registry_handlers.rest.rest_handler
        • nat.registry_handlers.schemas
          • nat.registry_handlers.schemas.headers
          • nat.registry_handlers.schemas.package
          • nat.registry_handlers.schemas.publish
          • nat.registry_handlers.schemas.pull
          • nat.registry_handlers.schemas.remove
          • nat.registry_handlers.schemas.search
          • nat.registry_handlers.schemas.status
      • nat.retriever
        • nat.retriever.interface
        • nat.retriever.milvus
          • nat.retriever.milvus.register
          • nat.retriever.milvus.retriever
        • nat.retriever.models
        • nat.retriever.nemo_retriever
          • nat.retriever.nemo_retriever.register
          • nat.retriever.nemo_retriever.retriever
        • nat.retriever.register
      • nat.runtime
        • nat.runtime.loader
        • nat.runtime.metrics
        • nat.runtime.runner
        • nat.runtime.session
        • nat.runtime.user_manager
        • nat.runtime.user_metadata
      • nat.settings
        • nat.settings.global_settings
      • nat.test
        • nat.test.embedder
        • nat.test.functions
        • nat.test.llm
        • nat.test.memory
        • nat.test.object_store_tests
        • nat.test.observability
        • nat.test.plugin
        • nat.test.register
        • nat.test.tool_test_runner
        • nat.test.utils
      • nat.tool
        • nat.tool.chat_completion
        • nat.tool.code_execution
          • nat.tool.code_execution.code_sandbox
          • nat.tool.code_execution.local_sandbox
            • nat.tool.code_execution.local_sandbox.local_sandbox_server
          • nat.tool.code_execution.register
          • nat.tool.code_execution.utils
        • nat.tool.datetime_tools
        • nat.tool.document_search
        • nat.tool.github_tools
        • nat.tool.memory_tools
          • nat.tool.memory_tools.add_memory_tool
          • nat.tool.memory_tools.delete_memory_tool
          • nat.tool.memory_tools.get_memory_tool
        • nat.tool.nvidia_rag
        • nat.tool.register
        • nat.tool.retriever
        • nat.tool.server_tools
      • nat.utils
        • nat.utils.atif_converter
        • nat.utils.atif_message_utils
        • nat.utils.callable_utils
        • nat.utils.data_models
          • nat.utils.data_models.schema_validator
        • nat.utils.debugging_utils
        • nat.utils.decorators
        • nat.utils.dump_distro_mapping
        • nat.utils.exception_handlers
          • nat.utils.exception_handlers.automatic_retries
          • nat.utils.exception_handlers.schemas
        • nat.utils.io
          • nat.utils.io.model_processing
          • nat.utils.io.supress_logs
          • nat.utils.io.yaml_tools
        • nat.utils.log_levels
        • nat.utils.log_utils
        • nat.utils.metadata_utils
        • nat.utils.optional_imports
        • nat.utils.producer_consumer_queue
        • nat.utils.reactive
          • nat.utils.reactive.base
            • nat.utils.reactive.base.observable_base
            • nat.utils.reactive.base.observer_base
            • nat.utils.reactive.base.subject_base
          • nat.utils.reactive.observable
          • nat.utils.reactive.observer
          • nat.utils.reactive.subject
          • nat.utils.reactive.subscription
        • nat.utils.responses_api
        • nat.utils.settings
          • nat.utils.settings.global_settings
        • nat.utils.string_utils
        • nat.utils.type_converter
        • nat.utils.type_utils
        • nat.utils.url_utils
    • observability
      • observability.exporter
        • observability.exporter.dfw_elasticsearch_exporter
        • observability.exporter.dfw_exporter
      • observability.mixin
        • observability.mixin.elasticsearch_mixin
      • observability.processor
        • observability.processor.dfw_record_processor
        • observability.processor.trace_conversion
          • observability.processor.trace_conversion.adapter
            • observability.processor.trace_conversion.adapter.elasticsearch
            • observability.processor.trace_conversion.adapter.register
          • observability.processor.trace_conversion.span_extractor
          • observability.processor.trace_conversion.span_to_dfw
          • observability.processor.trace_conversion.trace_adapter_registry
      • observability.register
      • observability.schema
        • observability.schema.provider
          • observability.schema.provider.nim_trace_source
          • observability.schema.provider.openai_message
          • observability.schema.provider.openai_trace_source
        • observability.schema.register
        • observability.schema.schema_registry
        • observability.schema.sink
          • observability.schema.sink.elasticsearch
            • observability.schema.sink.elasticsearch.contract_version
            • observability.schema.sink.elasticsearch.dfw_es_record
        • observability.schema.trace_container
        • observability.schema.trace_source_base
      • observability.utils
        • observability.utils.deserialize
    • optimizer_callbacks
  • REST API
    • API Server Endpoints
    • HTTP Interactive Execution
    • Evaluation API Endpoints
    • WebSocket Message Schema
  • Command Line Interface (CLI)

Resources

  • FAQs
  • Support
  • Troubleshooting
  • Migration Guide
  • Security Considerations
  • Contributing
    • Code of Conduct
    • Licensing
    • Cursor
      • Cursor Rules Developer Guide
      • Cursor Rules Reference
    • Testing Workflows
      • Running Tests
      • Running CI Locally
  • Authentication

Authentication#

  • User Identity Resolution
  • Authentication Provider API
  • MCP Authentication
  • A2A Authentication

previous

Text-to-SQL with Vanna

next

User Identity Resolution
NVIDIA NVIDIA
Privacy Policy | Your Privacy Choices | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © 2025, NVIDIA.