List ModelDeploymentConfigs By Workspace

GET

http://localhost:8080/apis/models/v2/workspaces/:workspace/deployment-configs

GET

/apis/models/v2/workspaces/:workspace/deployment-configs

curl http://localhost:8080/apis/models/v2/workspaces/workspace/deployment-configs

{
  "data": [
    {
      "name": "llama-3.1-8b",
      "workspace": "string",
      "created_at": "2024-01-15T09:30:00Z",
      "updated_at": "2024-01-15T09:30:00Z",
      "entity_version": 1,
      "engine": "nim",
      "model_spec": {
        "model_type": "llm",
        "model_namespace": "string",
        "model_name": "string",
        "model_revision": "string",
        "chat_template": "string",
        "tool_call_config": {
          "tool_call_parser": "string",
          "tool_call_plugin": "string",
          "auto_tool_choice": true
        },
        "lora_enabled": false
      },
      "executor_config": {
        "gpu": 1,
        "disk_size": "50Gi",
        "image_name": "string",
        "image_tag": "string",
        "health_check_path": "string",
        "run_as_user": 1,
        "run_as_group": 1,
        "additional_envs": {},
        "additional_args": [
          "string"
        ],
        "k8s_nim_operator_config": {
          "resources": {},
          "tolerations": [
            {}
          ],
          "node_selector": {},
          "startup_probe_grace_seconds": 1
        },
        "override_config": {}
      },
      "id": "string",
      "project": "string",
      "description": "string",
      "model_entity_id": "string"
    }
  ],
  "pagination": {
    "page": 1,
    "page_size": 1,
    "current_page_size": 1,
    "total_pages": 1,
    "total_results": 1
  },
  "sort": "string",
  "filter": {}
}

List ModelDeploymentConfigs for a specific workspace. Returns only the latest version of each config.

Path parameters

workspacestringRequired

Query parameters

sortstringOptionalDefaults to created_at

The field to sort by. To sort in decreasing order, use - in front of the field name.

pageintegerOptional>=1Defaults to 1

Page number.

page_sizeintegerOptional1-1000Defaults to 100

Page size.

filterobjectOptional

Filter deployment configs by workspace, project, model_entity_id, name, description, created_at, and updated_at.

Response

Return model deployment configurations for a workspace

datalist of objects

paginationobjectOptional

Pagination information.

sortstringOptional

The field on which the results are sorted.

filtermap from strings to anyOptional

Filtering information.

Errors

422

Unprocessable Entity Error