> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/nemo/relay/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/nemo/relay/_mcp/server.

# Struct Agent Hints

> Runtime hint bundle exposed to downstream integrations.

Generated from `cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker`.

<pre />

Runtime hint bundle exposed to downstream integrations.

These values summarize the current learned default behavior for an agent and are suitable for transport in provider-specific headers or metadata fields.

## Fields

### `osl: u32`

Output-size limit hint in tokens.

### `iat: u32`

Inter-arrival-time hint in milliseconds.

### `priority: i32`

Scheduling priority hint derived from latency sensitivity.

### `latency_sensitivity: f64`

Learned latency sensitivity score for the current prefix.

### `prefix_id: String`

Identifier of the prefix or trie node the hints came from.

### `total_requests: u32`

Estimated total number of requests in the workflow.

## Trait Implementations

### `impl Clone for AgentHints`

<pre />

#### `clone`

<pre />

#### `clone_from`

<pre />

### `impl Debug for AgentHints`

<pre />

#### `fmt`

<pre />

### `impl<'de> Deserialize<'de> for AgentHints`

<pre />

#### `deserialize`

<pre />

### `impl Serialize for AgentHints`

<pre />

#### `serialize`

<pre />