> This page is for NeMo Relay, version v0.10.0.
> For other versions, use one of these documentation indexes:
> - Latest (v0.10.0) (default): https://docs.nvidia.com/nemo/relay/latest/llms.txt
> - dev: https://docs.nvidia.com/nemo/relay/dev/llms.txt
> - v0.10.0: https://docs.nvidia.com/nemo/relay/v0.10.0/llms.txt
> - v0.9.4: https://docs.nvidia.com/nemo/relay/v0.9.4/llms.txt
> - v0.8.4: https://docs.nvidia.com/nemo/relay/v0.8.4/llms.txt
> - v0.7.3: https://docs.nvidia.com/nemo/relay/v0.7.3/llms.txt
> - v0.6.0: https://docs.nvidia.com/nemo/relay/v0.6.0/llms.txt
> - v0.5.0: https://docs.nvidia.com/nemo/relay/v0.5.0/llms.txt

> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/nemo/relay/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/nemo/relay/_mcp/server.

# Trait Relay Host Runtime

> Generated trait containing gRPC methods that should be implemented for use with RelayHostRuntimeServer.

Generated from `cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker`.

<pre />

Generated trait containing gRPC methods that should be implemented for use with RelayHostRuntimeServer.

## Required Associated Types

#### `LlmStreamNextStream`

<pre />

Server streaming response type for the LlmStreamNext method.

## Required Methods

#### `log`

<pre />

#### `emit_mark`

<pre />

#### `get_runtime_diagnostics`

<pre />

#### `push_scope`

<pre />

#### `pop_scope`

<pre />

#### `create_scope_stack`

<pre />

#### `drop_scope_stack`

<pre />

#### `tool_next`

<pre />

#### `llm_next`

<pre />

#### `llm_stream_next`

<pre />

#### `decode_llm_codec_request`

<pre />

#### `encode_llm_codec_request`

<pre />

#### `decode_llm_codec_response`

<pre />

#### `list_runtime_registrations`

<pre />

#### `register_conditional_middleware_guardrail`

<pre />

#### `deregister_conditional_middleware_guardrail`

<pre />

## Implementors