> This page is for version 1.14.0 (default).
> For other versions, use one of these documentation indexes:
> - 1.14.0 (default): https://docs.nvidia.com/nim/llama-3-1-nemotron-safety-guard-8b/1.14.0/llms.txt
> - 1.10.1: https://docs.nvidia.com/nim/llama-3-1-nemotron-safety-guard-8b/1.10.1/llms.txt

> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/nim/llama-3-1-nemotron-safety-guard-8b/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/nim/llama-3-1-nemotron-safety-guard-8b/_mcp/server.

# Llama Stack-compatible chat endpoint

POST /experimental/ls/inference/chat_completion
Content-Type: application/json

Reference: https://docs.nvidia.com/nim/llama-3-1-nemotron-safety-guard-8b/api-reference/create-llama-stack-chat-completion-experimental-ls-inference-chat-completion-post

## Request

### Body (application/json)

This endpoint expects a ChatCompletionRequest.

- `model` (string, required)
- `messages` (list of ChatCompletionRequestMessagesItems, required)
- `sampling_params` (SamplingParams, optional, nullable, default: {"max_tokens":0,"repetition_penalty":1,"strategy":"greedy","temperature":0,"top_k":0,"top_p":0.95})
- `tools` (list of ToolDefinition, optional, nullable)
- `tool_choice` (ChatCompletionRequestToolChoice, optional, nullable)
- `stream` (boolean, optional, nullable, default: false)
- `logprobs` (LogProbConfig, optional, nullable)

## Response

### 200

Successful Response

- `create_llama_stack_chat_completion_experimental_ls_inference_chat_completion_post_Response_200`
  - ChatCompletionResponse: nim_llm_sdk__entrypoints__llamastack__protocol__ChatCompletionResponse
  - ChatCompletionResponseStreamChunk: ChatCompletionResponseStreamChunk

## Errors

### 400 Bad Request Error

Received an invalid request possibly containing unsupported or out-of-range parameter values.

- `message` (string, required)
- `type` (string, required)
- `code` (integer, required)
- `object` (string, optional, default: error)
- `param` (string, optional, nullable)

### 404 Not Found Error

The requested model does not exist.

- `message` (string, required)
- `type` (string, required)
- `code` (integer, required)
- `object` (string, optional, default: error)
- `param` (string, optional, nullable)

### 415 Unsupported Media Type Error

Unsupported Media Type

- `message` (string, required)
- `type` (string, required)
- `code` (integer, required)
- `object` (string, optional, default: error)
- `param` (string, optional, nullable)

### 422 Unprocessable Entity Error

Validation Error

- `detail` (list of ValidationError, optional)

### 500 Internal Server Error

Internal Server Error

- `message` (string, required)
- `type` (string, required)
- `code` (integer, required)
- `object` (string, optional, default: error)
- `param` (string, optional, nullable)

## Types

### ChatCompletionRequestMessagesItems

- `role`: `assistant` (CompletionMessage)
  - `content` (CompletionMessageInputContent, required)
  - `stop_reason` (enum, required)
    - Allowed values: `end_of_turn`, `end_of_message`, `out_of_tokens`
  - `tool_calls` (list of nim_llm_sdk__entrypoints__llamastack__protocol__ToolCall, optional)
- `role`: `ipython` (ToolResponseMessage)
  - `call_id` (string, required)
  - `content` (ToolResponseMessageContent, required)
  - `tool_name` (ToolResponseMessageToolName, required)
- `role`: `system` (SystemMessage)
  - `content` (SystemMessageContent, required)
- `role`: `user` (UserMessage)
  - `content` (UserMessageContent, required)

### SamplingParams

- `strategy` (enum, optional)
  - Allowed values: `greedy`, `top_p`, `top_k`
- `temperature` (double, optional, nullable, default: 0)
- `top_p` (double, optional, nullable, default: 0.95)
- `top_k` (integer, optional, nullable, default: 0)
- `max_tokens` (integer, optional, nullable, default: 0)
- `repetition_penalty` (double, optional, nullable, default: 1)

### ToolDefinition

- `tool_name` (ToolDefinitionToolName, required)
- `description` (string, optional, nullable)
- `parameters` (map from string to ToolParamDefinition, optional, nullable)

### ChatCompletionRequestToolChoice

- "auto"
- "required"

### LogProbConfig

- `top_k` (integer, optional, nullable, default: 0)

### nim_llm_sdk__entrypoints__llamastack__protocol__ChatCompletionResponse

- `completion_message` (CompletionMessage-Output, required)
- `logprobs` (list of TokenLogProbs, optional, nullable)

### ChatCompletionResponseStreamChunk

SSE-stream of these events.

- `event` (ChatCompletionResponseEvent, required) — Chat completion response event.

### ValidationError

- `loc` (list of ValidationErrorLocItems, required)
- `msg` (string, required)
- `type` (string, required)

### CompletionMessageInputContent

- string
- Attachment: Attachment
- list of CompletionMessageInputContentOneOf2Items

### nim_llm_sdk__entrypoints__llamastack__protocol__ToolCall

- `tool_name` (NimLlmSdkEntrypointsLlamastackProtocolToolCallToolName, required)
- `call_id` (string, optional)
- `arguments` (map from string to NimLlmSdkEntrypointsLlamastackProtocolToolCallArguments, optional, nullable)

### ToolResponseMessageContent

- string
- Attachment: Attachment
- list of ToolResponseMessageContentOneOf2Items

### ToolResponseMessageToolName

- BuiltinTool: enum
  - Allowed values: `brave_search`, `wolfram_alpha`, `photogen`, `code_interpreter`
- string

### SystemMessageContent

- string
- Attachment: Attachment
- list of SystemMessageContentOneOf2Items

### UserMessageContent

- string
- Attachment: Attachment
- list of UserMessageContentOneOf2Items

### ToolDefinitionToolName

- BuiltinTool: enum
  - Allowed values: `brave_search`, `wolfram_alpha`, `photogen`, `code_interpreter`
- string

### ToolParamDefinition

- `param_type` (string, required)
- `description` (string, optional, nullable)
- `required` (boolean, optional, nullable, default: true)

### CompletionMessage-Output

- `content` (CompletionMessageOutputContent, required)
- `stop_reason` (enum, required)
  - Allowed values: `end_of_turn`, `end_of_message`, `out_of_tokens`
- `role` ("assistant", optional, default: assistant)
- `tool_calls` (list of nim_llm_sdk__entrypoints__llamastack__protocol__ToolCall, optional)

### TokenLogProbs

- `logprobs_by_token` (map from string to double, required)

### ChatCompletionResponseEvent

Chat completion response event.

- `event_type` (enum, required)
  - Allowed values: `start`, `complete`, `progress`
- `delta` (ChatCompletionResponseEventDelta, required)
- `logprobs` (list of TokenLogProbs, optional, nullable)
- `stop_reason` (enum, optional, nullable)
  - Allowed values: `end_of_turn`, `end_of_message`, `out_of_tokens`

### ValidationErrorLocItems

- string
- integer

### Attachment

- `url` (URL, required)
- `mime_type` (string, required)

### CompletionMessageInputContentOneOf2Items

- string
- Attachment: Attachment

### NimLlmSdkEntrypointsLlamastackProtocolToolCallToolName

- BuiltinTool: enum
  - Allowed values: `brave_search`, `wolfram_alpha`, `photogen`, `code_interpreter`
- string

### NimLlmSdkEntrypointsLlamastackProtocolToolCallArguments

- string
- integer
- double
- boolean
- list of NimLlmSdkEntrypointsLlamastackProtocolToolCallArgumentsOneOf4Items
- map from string to NimLlmSdkEntrypointsLlamastackProtocolToolCallArgumentsOneOf5

### ToolResponseMessageContentOneOf2Items

- string
- Attachment: Attachment

### SystemMessageContentOneOf2Items

- string
- Attachment: Attachment

### UserMessageContentOneOf2Items

- string
- Attachment: Attachment

### CompletionMessageOutputContent

- string
- Attachment: Attachment
- list of CompletionMessageOutputContentOneOf2Items

### ChatCompletionResponseEventDelta

- string
- ToolCallDelta: ToolCallDelta

### URL

- `uri` (string, required)

### NimLlmSdkEntrypointsLlamastackProtocolToolCallArgumentsOneOf4Items

- string
- integer
- double
- boolean

### NimLlmSdkEntrypointsLlamastackProtocolToolCallArgumentsOneOf5

- string
- integer
- double
- boolean

### CompletionMessageOutputContentOneOf2Items

- string
- Attachment: Attachment

### ToolCallDelta

- `content` (ToolCallDeltaContent, required)
- `parse_status` (enum, required)
  - Allowed values: `start`, `in_progress`, `failure`, `success`

### ToolCallDeltaContent

- string
- ToolCall: nim_llm_sdk__entrypoints__llamastack__protocol__ToolCall

## Examples

**Request**

```json
{
  "model": "string",
  "messages": [
    {
      "content": "string"
    }
  ]
}
```

**Response**

```json
{
  "completion_message": {
    "content": "string",
    "role": "assistant",
    "stop_reason": "end_of_turn",
    "tool_calls": [
      {
        "arguments": {},
        "call_id": "string",
        "tool_name": "brave_search"
      }
    ]
  },
  "logprobs": [
    {
      "logprobs_by_token": {}
    }
  ]
}
```

**SDK Code**

```python
import requests

url = "https://api.example.com/experimental/ls/inference/chat_completion"

payload = {
    "model": "string",
    "messages": [{ "content": "string" }]
}
headers = {"Content-Type": "application/json"}

response = requests.post(url, json=payload, headers=headers)

print(response.json())
```

```javascript
const url = 'https://api.example.com/experimental/ls/inference/chat_completion';
const options = {
  method: 'POST',
  headers: {'Content-Type': 'application/json'},
  body: '{"model":"string","messages":[{"content":"string"}]}'
};

try {
  const response = await fetch(url, options);
  const data = await response.json();
  console.log(data);
} catch (error) {
  console.error(error);
}
```

```go
package main

import (
	"fmt"
	"strings"
	"net/http"
	"io"
)

func main() {

	url := "https://api.example.com/experimental/ls/inference/chat_completion"

	payload := strings.NewReader("{\n  \"model\": \"string\",\n  \"messages\": [\n    {\n      \"content\": \"string\"\n    }\n  ]\n}")

	req, _ := http.NewRequest("POST", url, payload)

	req.Header.Add("Content-Type", "application/json")

	res, _ := http.DefaultClient.Do(req)

	defer res.Body.Close()
	body, _ := io.ReadAll(res.Body)

	fmt.Println(res)
	fmt.Println(string(body))

}
```

```ruby
require 'uri'
require 'net/http'

url = URI("https://api.example.com/experimental/ls/inference/chat_completion")

http = Net::HTTP.new(url.host, url.port)
http.use_ssl = true

request = Net::HTTP::Post.new(url)
request["Content-Type"] = 'application/json'
request.body = "{\n  \"model\": \"string\",\n  \"messages\": [\n    {\n      \"content\": \"string\"\n    }\n  ]\n}"

response = http.request(request)
puts response.read_body
```

```java
import com.mashape.unirest.http.HttpResponse;
import com.mashape.unirest.http.Unirest;

HttpResponse<String> response = Unirest.post("https://api.example.com/experimental/ls/inference/chat_completion")
  .header("Content-Type", "application/json")
  .body("{\n  \"model\": \"string\",\n  \"messages\": [\n    {\n      \"content\": \"string\"\n    }\n  ]\n}")
  .asString();
```

```php
<?php
require_once('vendor/autoload.php');

$client = new \GuzzleHttp\Client();

$response = $client->request('POST', 'https://api.example.com/experimental/ls/inference/chat_completion', [
  'body' => '{
  "model": "string",
  "messages": [
    {
      "content": "string"
    }
  ]
}',
  'headers' => [
    'Content-Type' => 'application/json',
  ],
]);

echo $response->getBody();
```

```csharp
using RestSharp;

var client = new RestClient("https://api.example.com/experimental/ls/inference/chat_completion");
var request = new RestRequest(Method.POST);
request.AddHeader("Content-Type", "application/json");
request.AddParameter("application/json", "{\n  \"model\": \"string\",\n  \"messages\": [\n    {\n      \"content\": \"string\"\n    }\n  ]\n}", ParameterType.RequestBody);
IRestResponse response = client.Execute(request);
```

```swift
import Foundation

let headers = ["Content-Type": "application/json"]
let parameters = [
  "model": "string",
  "messages": [["content": "string"]]
] as [String : Any]

let postData = JSONSerialization.data(withJSONObject: parameters, options: [])

let request = NSMutableURLRequest(url: NSURL(string: "https://api.example.com/experimental/ls/inference/chat_completion")! as URL,
                                        cachePolicy: .useProtocolCachePolicy,
                                    timeoutInterval: 10.0)
request.httpMethod = "POST"
request.allHTTPHeaderFields = headers
request.httpBody = postData as Data

let session = URLSession.shared
let dataTask = session.dataTask(with: request as URLRequest, completionHandler: { (data, response, error) -> Void in
  if (error != nil) {
    print(error as Any)
  } else {
    let httpResponse = response as? HTTPURLResponse
    print(httpResponse)
  }
})

dataTask.resume()
```