This page is for NeMo Relay, version Latest (v0.10.0) (default).
For other versions, use one of these documentation indexes:
- Latest (v0.10.0) (default): https://docs.nvidia.com/nemo/relay/latest/llms.txt
- dev: https://docs.nvidia.com/nemo/relay/dev/llms.txt
- v0.10.0: https://docs.nvidia.com/nemo/relay/v0.10.0/llms.txt
- v0.9.4: https://docs.nvidia.com/nemo/relay/v0.9.4/llms.txt
- v0.8.4: https://docs.nvidia.com/nemo/relay/v0.8.4/llms.txt
- v0.7.3: https://docs.nvidia.com/nemo/relay/v0.7.3/llms.txt
- v0.6.0: https://docs.nvidia.com/nemo/relay/v0.6.0/llms.txt
- v0.5.0: https://docs.nvidia.com/nemo/relay/v0.5.0/llms.txt
Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.
Built-in codec for the OpenAI Chat Completions API.
Implements LlmCodec (request decode/encode) and LlmResponseCodec (response decode) for the OpenAI Chat Completions format.
Structs
- OpenAIChatCodec: Built-in codec for the OpenAI Chat Completions API.
- OpenAIChatStreamingCodec: Streaming counterpart to
OpenAIChatCodec.
