nat.front_ends.fastapi.routes.v1_chat_completions#

OpenAI v1 chat completions route registration.

Attributes#

logger

Functions#

post_openai_api_compatible_endpoint(*, worker, ...)

Build OpenAI Chat Completions compatible POST handler.

add_v1_chat_completions_route(worker, app, *, path, ...)

Register OpenAI v1 chat completions endpoint.

Module Contents#

logger#
post_openai_api_compatible_endpoint(
*,
worker: Any,
session_manager: nat.runtime.session.SessionManager,
enable_interactive: bool,
)#

Build OpenAI Chat Completions compatible POST handler.

async add_v1_chat_completions_route(
worker: Any,
app: fastapi.FastAPI,
*,
path: str,
method: str,
description: str,
session_manager: nat.runtime.session.SessionManager,
enable_interactive: bool,
)#

Register OpenAI v1 chat completions endpoint.