Enum Provider Feature

View as Markdown

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-ffi.

1pub enum ProviderFeature {
2 ExplicitCacheBreakpoints,
3 AutomaticPrefixCaching,
4 RetentionTiers,
5 PriorityScheduling,
6 ModelRouting,
7 DeferredToolLoading,
8 FileReferences,
9 StructuredOutput,
10 PrefixAffinityHints,
11 StreamingTokenCounts,
12}

Feature that a backend or model family may support.

Used by the capability registry and policy engine to determine which optimization intents can be expressed for a given target.

Variants

ExplicitCacheBreakpoints

ExplicitCacheBreakpoints

Backend supports explicit cache control breakpoints (e.g., Anthropic).

AutomaticPrefixCaching

AutomaticPrefixCaching

Backend uses automatic prefix caching (e.g., OpenAI).

RetentionTiers

RetentionTiers

Backend supports retention tier control.

PriorityScheduling

PriorityScheduling

Backend supports priority-based scheduling.

ModelRouting

ModelRouting

Backend supports model routing/selection.

DeferredToolLoading

DeferredToolLoading

Backend supports deferred tool loading.

FileReferences

FileReferences

Backend supports file/artifact references in prompts.

StructuredOutput

StructuredOutput

Backend supports structured output schemas.

PrefixAffinityHints

PrefixAffinityHints

Backend supports prefix-affinity routing hints.

StreamingTokenCounts

StreamingTokenCounts

Backend reports per-chunk token counts in streaming responses.

Trait Implementations

impl Clone for ProviderFeature

impl Clone for ProviderFeature

clone

fn clone(&self) -> ProviderFeature

clone_from

fn clone_from(&mut self, source: &Self)

impl Debug for ProviderFeature

impl Debug for ProviderFeature

fmt

fn fmt(&self, f: &mut Formatter<'_>) -> Result

impl<'de> Deserialize<'de> for ProviderFeature

impl<'de> Deserialize<'de> for ProviderFeature

deserialize

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
    __D: Deserializer<'de>,

impl Hash for ProviderFeature

impl Hash for ProviderFeature

hash

fn hash<__H: Hasher>(&self, state: &mut __H)

hash_slice

fn hash_slice<H>(data: &[Self], state: &mut H)where
    H: Hasher,
    Self: Sized,

impl PartialEq for ProviderFeature

impl PartialEq for ProviderFeature

eq

fn eq(&self, other: &ProviderFeature) -> bool

ne

fn ne(&self, other: &Rhs) -> bool

impl Serialize for ProviderFeature

impl Serialize for ProviderFeature

serialize

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>where
    __S: Serializer,

impl Copy for ProviderFeature

impl Copy for ProviderFeature

impl Eq for ProviderFeature

impl Eq for ProviderFeature

impl StructuralPartialEq for ProviderFeature

impl StructuralPartialEq for ProviderFeature