nemo_gym.server_runtime.request_handling.disconnect

Middleware that cancels a request’s handler when its client disconnects.

Module Contents

Classes

Name	Description
`ClientDisconnectCancellationMiddleware`	Cancel an in-flight HTTP request when its client disconnects.

Functions

Name	Description
`_cancelled_request_route`	Return a registered route template, never a path containing request or rollout IDs.

API

class nemo_gym.server_runtime.request_handling.disconnect.ClientDisconnectCancellationMiddleware(
    app: starlette.types.ASGIApp
)

Cancel an in-flight HTTP request when its client disconnects.

num_cancelled

= 0

nemo_gym.server_runtime.request_handling.disconnect.ClientDisconnectCancellationMiddleware.__call__(
    scope: starlette.types.Scope,
    receive: starlette.types.Receive,
    send: starlette.types.Send
) -> None

async

nemo_gym.server_runtime.request_handling.disconnect.ClientDisconnectCancellationMiddleware._handle(
    scope: starlette.types.Scope,
    receive: starlette.types.Receive,
    send: starlette.types.Send,
    counts: typing.Any
) -> None

async

nemo_gym.server_runtime.request_handling.disconnect._cancelled_request_route(
    scope: starlette.types.Scope
) -> str

Return a registered route template, never a path containing request or rollout IDs.