For AI agents: a documentation index is available at the root level at /llms.txt and /llms-full.txt. Append /llms.txt to any URL for a page-level index, or .md for the markdown version of any page.
  • Getting Started
    • Welcome
    • Contributing
  • Concepts
    • Columns
    • Seed Datasets
    • Agent Rollout Ingestion
      • Default Model Settings
      • Configure with the CLI
      • Custom Model Settings
      • Model Providers
      • Model Configs
      • Inference Parameters
    • Custom Columns
    • Validators
    • Processors
    • Person Sampling
    • Traces
    • Architecture & Performance
    • Deployment Options
    • Security
  • Tutorials
    • Overview
    • The Basics
    • Structured Outputs, Jinja Expressions, and Conditional Generation
    • Seeding with an External Dataset
    • Providing Images as Context
    • Generating Images
    • Image-to-Image Editing
  • Recipes
    • Recipe Cards
  • Plugins
    • Overview
    • Example Plugin
    • FileSystemSeedReader Plugins
    • Discover
  • Code Reference
    • Overview
  • Dev Notes
    • Overview
    • Push Datasets to Hugging Face Hub
    • Text-to-SQL for Nemotron Super
    • Async All the Way Down
    • Owning the Model Stack
    • Data Designer Got Skills
NVIDIANVIDIA
Developer-friendly docs for your API
Privacy Policy | Manage My Privacy | Do Not Sell or Share My Data | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © 2026, NVIDIA Corporation.

LogoLogoNeMo Data Designer
On this page
  • Overview
  • ModelProvider Configuration
  • Supported Provider Types
  • API Key Configuration
  • See Also
ConceptsModels

Model Providers

||View as Markdown|
Previous

Custom Model Settings

Next

Model Configurations

Model providers are external services that host and serve models. Data Designer uses the ModelProvider class to configure connections to these services.

Overview

A ModelProvider defines how Data Designer connects to a provider’s API endpoint. When you create a ModelConfig, you reference a provider by name, and Data Designer uses that provider’s settings to make API calls to the appropriate endpoint.

Deprecated: implicit default provider routing

Earlier versions of Data Designer let you omit provider= on ModelConfig and fall back to a registry-level default — including the default: key in ~/.data-designer/model_providers.yaml. That implicit routing is deprecated and will be removed in a future release. Always reference a provider by name on every ModelConfig. A DeprecationWarning is now emitted when the legacy path is exercised. See issue #589.

ModelProvider Configuration

The ModelProvider class has the following fields:

FieldTypeRequiredDescription
namestrYesUnique identifier for the provider (e.g., "nvidia", "openai", "openrouter")
endpointstrYesAPI endpoint URL (e.g., "https://integrate.api.nvidia.com/v1")
provider_typestrNoProvider type: "openai" (default) or "anthropic". See Supported Provider Types below
api_keystrNoAPI key or environment variable name (e.g., "NVIDIA_API_KEY")
extra_bodydict[str, Any]NoAdditional parameters to include in the request body of all API requests to the provider.
extra_headersdict[str, str]NoAdditional headers to include in all API requests to the provider.

Supported Provider Types

Data Designer supports two provider types:

TypeDescription
"openai"OpenAI-compatible chat completion API. This is the default and works with most providers, including NVIDIA NIM, vLLM, TGI, OpenRouter, Together AI, and OpenAI itself.
"anthropic"Anthropic’s native Messages API for Claude models. Use this when connecting directly to Anthropic’s API.

Most self-hosted and third-party endpoints expose an OpenAI-compatible API, so provider_type="openai" is the right choice in the majority of cases. Only use "anthropic" when connecting directly to Anthropic’s API at https://api.anthropic.com.

Note: Previous versions of Data Designer supported additional provider types (e.g., "azure", "bedrock", "vertex_ai") via a LiteLLM bridge. These are no longer supported. If you were using one of these types, switch to provider_type="openai" and point the endpoint to an OpenAI-compatible proxy or gateway for that service.

API Key Configuration

The api_key field can be specified in two ways:

  1. Environment variable name (recommended): Set api_key to the name of an environment variable (e.g., "NVIDIA_API_KEY"). Data Designer will automatically resolve it at runtime.

  2. Plain-text value: Set api_key to the actual API key string. This is less secure and not recommended for production use.

1# Method 1: Environment variable (recommended)
2provider = ModelProvider(
3 name="nvidia",
4 endpoint="https://integrate.api.nvidia.com/v1",
5 api_key="NVIDIA_API_KEY", # Will be resolved from environment
6)
7
8# Method 2: Direct value (not recommended)
9provider = ModelProvider(
10 name="nvidia",
11 endpoint="https://integrate.api.nvidia.com/v1",
12 api_key="nvapi-abc123...", # Direct API key
13)

See Also

  • Model Configurations: Learn about configuring models
  • Inference Parameters: Detailed guide to inference parameters and how to configure them
  • Default Model Settings: Pre-configured providers and model settings included with Data Designer
  • Custom Model Settings: Learn how to create custom providers and model configurations
  • Model Configurations: Learn about configuring models
  • Inference Parameters: Detailed guide to inference parameters and how to configure them
  • Configure Model Settings With the CLI: Use the CLI to manage providers and model settings
  • Getting Started: Installation and basic usage example