Enum ApiSpecific Request | NVIDIA NeMo Relay

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.

pub enum ApiSpecificRequest {
    AnthropicMessages {
        cache_control: Option<Value>,
        container: Option<String>,
        inference_geo: Option<String>,
        output_config: Option<Value>,
        thinking: Option<Value>,
        top_k: Option<u64>,
        user_profile_id: Option<String>,
    },
    OpenAIChat {Show 21 fields
        audio: Option<Value>,
        frequency_penalty: Option<f64>,
        function_call: Option<Value>,
        functions: Option<Vec<Value>>,
        logit_bias: Option<Value>,
        logprobs: Option<bool>,
        modalities: Option<Vec<String>>,
        moderation: Option<Value>,
        n: Option<u64>,
        prediction: Option<Value>,
        presence_penalty: Option<f64>,
        prompt_cache_key: Option<String>,
        prompt_cache_options: Option<Value>,
        prompt_cache_retention: Option<String>,
        reasoning_effort: Option<String>,
        response_format: Option<Value>,
        safety_identifier: Option<String>,
        seed: Option<i64>,
        stream_options: Option<Value>,
        verbosity: Option<String>,
        web_search_options: Option<Value>,
    },
    OpenAIResponses {
        background: Option<bool>,
        context_management: Option<Value>,
        conversation: Option<Value>,
        moderation: Option<Value>,
        prompt: Option<Value>,
        prompt_cache_key: Option<String>,
        prompt_cache_options: Option<Value>,
        prompt_cache_retention: Option<String>,
        safety_identifier: Option<String>,
        stream_options: Option<Value>,
        text: Option<Value>,
    },
    Custom {
        api_name: String,
        data: Value,
    },
}

API-specific request fields that do not have portable semantics.

Variants

`AnthropicMessages`

AnthropicMessages

Anthropic Messages-specific request fields.

Fields

`cache_control: Option<Value>`

Top-level prompt cache control.

`container: Option<String>`

Reusable container identifier.

`inference_geo: Option<String>`

Requested inference geography.

`output_config: Option<Value>`

Provider output configuration.

`thinking: Option<Value>`

Extended-thinking configuration.

`top_k: Option<u64>`

Top-k sampling limit.

`user_profile_id: Option<String>`

User profile attribution identifier.

`OpenAIChat`

OpenAIChat

OpenAI Chat Completions-specific request fields.

Fields

`audio: Option<Value>`

Audio output configuration.

`frequency_penalty: Option<f64>`

Frequency penalty.

`function_call: Option<Value>`

Deprecated function-call control.

`functions: Option<Vec<Value>>`

Deprecated function definitions.

`logit_bias: Option<Value>`

Token logit bias map.

`logprobs: Option<bool>`

Whether token log probabilities are requested.

`modalities: Option<Vec<String>>`

Requested output modalities.

`moderation: Option<Value>`

Request moderation configuration.

`n: Option<u64>`

Number of completion choices.

`prediction: Option<Value>`

Predicted output content.

`presence_penalty: Option<f64>`

Presence penalty.

`prompt_cache_key: Option<String>`

Prompt cache routing key.

`prompt_cache_options: Option<Value>`

Prompt cache configuration.

`prompt_cache_retention: Option<String>`

Deprecated prompt cache retention policy.

`reasoning_effort: Option<String>`

Requested reasoning effort.

`response_format: Option<Value>`

Structured response format configuration.

`safety_identifier: Option<String>`

Stable safety identifier.

`seed: Option<i64>`

Best-effort deterministic sampling seed.

`stream_options: Option<Value>`

Streaming response configuration.

`verbosity: Option<String>`

Requested response verbosity.

`web_search_options: Option<Value>`

Web-search configuration.

`OpenAIResponses`

OpenAIResponses

OpenAI Responses-specific request fields.

Fields

`background: Option<bool>`

Whether the response should run in the background.

`context_management: Option<Value>`

Context-management entries.

`conversation: Option<Value>`

Conversation identifier or object.

`moderation: Option<Value>`

Request moderation configuration.

`prompt: Option<Value>`

Reusable prompt template reference.

`prompt_cache_key: Option<String>`

Prompt cache routing key.

`prompt_cache_options: Option<Value>`

Prompt cache configuration.

`prompt_cache_retention: Option<String>`

Deprecated prompt cache retention policy.

`safety_identifier: Option<String>`

Stable safety identifier.

`stream_options: Option<Value>`

Streaming response configuration.

`text: Option<Value>`

Text output configuration.

`Custom`

Custom

Custom provider request fields.

Fields

`api_name: String`

Custom API identifier.

`data: Value`

Opaque custom API data.

Trait Implementations

`impl Clone for ApiSpecificRequest`

impl Clone for ApiSpecificRequest

`clone`

fn clone(&self) -> ApiSpecificRequest

`clone_from`

fn clone_from(&mut self, source: &Self)

`impl Debug for ApiSpecificRequest`

impl Debug for ApiSpecificRequest

`fmt`

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

`impl<'de> Deserialize<'de> for ApiSpecificRequest`

impl<'de> Deserialize<'de> for ApiSpecificRequest

`deserialize`

fn deserialize<__D>(
    __deserializer: __D,
) -> Result<ApiSpecificRequest, <__D as Deserializer<'de>>::Error>where
    __D: Deserializer<'de>,

`impl PartialEq for ApiSpecificRequest`

impl PartialEq for ApiSpecificRequest

`eq`

fn eq(&self, other: &ApiSpecificRequest) -> bool

`ne`

fn ne(&self, other: &Rhs) -> bool

`impl Serialize for ApiSpecificRequest`

impl Serialize for ApiSpecificRequest

`serialize`

fn serialize<__S>(
    &self,
    __serializer: __S,
) -> Result<<__S as Serializer>::Ok, <__S as Serializer>::Error>where
    __S: Serializer,

`impl StructuralPartialEq for ApiSpecificRequest`

impl StructuralPartialEq for ApiSpecificRequest