Configure Plugins

Use this section to configure plugin behavior that Relay loads for a process. The runtime discovers and layers plugins.toml for direct Rust, Python, and Node.js integrations as well as for the nemo-relay CLI gateway.

Choose the path that matches your goal:

Goal	Start here
Configure a built-in Relay component	Choose the component guide below. Use `plugins.toml` or the binding API.
Add a plugin someone else packaged	Configure Discoverable Plugins
Create a reusable plugin	Build Plugins

Built-in Plugins

Relay ships these first-party components. Configure them as [[components]] entries in plugins.toml.

Observability exports ATOF, ATIF, OpenTelemetry, or OpenInference data.
Adaptive configures adaptive runtime behavior.
NeMo Guardrails installs Guardrails-backed policy checks.
PII Redaction sanitizes sensitive data in observability payloads.
Model Pricing configures catalog sources for cost estimates on managed LLM responses.

Guides

Follow the guides below to configure plugins.

Plugin Configuration Files explains runtime plugins.toml discovery, precedence, merging, and CLI editing.
Configure Discoverable Plugins explains manifest-backed native and worker plugin installation, validation, trust policy, and activation.

Use Build Plugins only when you are authoring the plugin itself. It covers generic plugin components, manifests, native ABI plugins, Python workers, and the grpc-v1 protocol.