Skip to navigation
API Reference

LlamaStack-compatible completion endpoint

View as Markdown

Request

This endpoint expects an object.
modelstringRequired
contentstring or object or list of strings or objectsRequired
sampling_paramsobject or nullOptionalDefaults to {"max_tokens":0,"repetition_penalty":1,"strategy":"greedy","temperature":0,"top_k":0,"top_p":0.95}
streamboolean or nullOptionalDefaults to false
logprobsobject or nullOptional

Response

Successful Response
CompletionResponseobject
OR
CompletionResponseStreamChunkobject
streamed completion response.

Errors

400
Bad Request Error
404
Not Found Error
415
Unsupported Media Type Error
422
Unprocessable Entity Error
500
Internal Server Error