Model Context Protocol (MCP)

NeMo Agent toolkit Model Context Protocol (MCP) integration includes:

• An MCP client to connect to and use tools served by remote MCP servers.

• An MCP server to publish tools using MCP to be used by any MCP client.

Note: MCP client functionality requires the nvidia-nat-mcp package. Install it with uv pip install "nvidia-nat[mcp]".

MCP

• Connecting to Remote Tools
  • Installation
  • Accessing Protected MCP Servers
  • MCP Client Configuration
    • mcp_client Configuration
      • Configuration Options
        • Server Configuration
        • Timeout Configuration
        • Reconnection Configuration
        • Session Management Configuration
        • Tool Customization
    • mcp_tool_wrapper Configuration
  • Transport Configuration
    • Transport Types
    • Streamable-HTTP Mode Configuration
    • SSE Mode Configuration
    • STDIO Mode Configuration
  • Example
  • Displaying MCP Tools using the CLI
    • List All Tools
    • Get Tool Details
    • Call a Tool
    • Using Protected MCP Servers
  • List MCP Client Tools using the HTTP endpoint
    • Steps
    • Endpoint
    • Sample Output
  • MCP Inspection via UI
    • Steps
    • Sample Output
    • Troubleshooting
• Serving NeMo Agent toolkit Functions
  • MCP Server Usage
    • Filtering MCP Tools
  • Displaying MCP Tools published by an MCP server
    • Debug route for listing tools (no MCP client required)
  • Integration with MCP Clients
    • Example
  • Verifying MCP Server Health
    • Using the /health route
    • Using the nat mcp client ping command
  • Security Considerations
    • Authentication Limitations
    • Local Development
    • Production Deployment
• MCP Authentication
  • Supported Capabilities
  • Configuring an Auth Provider
    • Environment Variables
  • Referencing Auth Providers in Clients
  • Limitations and Supported Transports
    • Supported Transports
    • Configuration Compatibility
  • Example Workflow
    • Example Configuration
    • Running the Workflow in Single-User Mode (CLI)
    • Running the Workflow in Multi-User Mode (FastAPI)
    • Running the Workflow on a Remote Server
      • Why This Is Required
      • Configuration
  • Displaying Protected MCP Tools through the CLI
  • Security Considerations
    • Transport Security
    • Authentication Best Practices
    • Deployment Recommendations
  • Troubleshooting
  • Related Documentation
• Secure Token Storage
  • Overview
    • Components
  • Configuration
    • Default Configuration (In-Memory Storage)
    • External Object Store Configuration
  • Token Storage Format
  • Token Lifecycle
    • Initial Authentication
    • Token Retrieval
    • Token Refresh
  • Custom Token Storage
  • Related Documentation