Update ModelProvider Status Fields

PUT

https://host.com/apis/models/v2/workspaces/:workspace/providers/:name/status

PUT

/apis/models/v2/workspaces/:workspace/providers/:name/status

$ curl -X PUT https://host.com/apis/models/v2/workspaces/workspace/providers/name/status \
>      -H "Content-Type: application/json" \
>      -d '{}'

1 {
2   "name": "llama-3.1-8b",
3   "workspace": "ml-workspace",
4   "created_at": "2024-01-15T09:30:00Z",
5   "updated_at": "2024-01-15T09:30:00Z",
6   "host_url": "https://models.example.com/llama-3.1-8b",
7   "id": "provider-12345",
8   "project": "ml-project-2024",
9   "description": "LLaMA 3 8B model provider for inference",
10   "api_key_secret_name": "llama3_api_key",
11   "served_models": [
12     {
13       "model_entity_id": "ml-workspace/llama-3.1-8b",
14       "served_model_name": "llama-3.1-8b-v1"
15     }
16   ],
17   "enabled_models": [
18     "llama-3.1-8b-v1"
19   ],
20   "status": "READY",
21   "status_message": "Model provider is active and ready to serve requests.",
22   "default_extra_body": {},
23   "default_extra_headers": {},
24   "required_extra_body": {},
25   "required_extra_headers": {},
26   "model_deployment_id": "deployment-67890",
27   "auth_context": {
28     "principal_id": "user-abc123",
29     "principal_email": "user@example.com",
30     "principal_groups": [
31       "ml-engineers",
32       "data-scientists"
33     ],
34     "principal_on_behalf_of": "user-def456",
35     "principal_on_behalf_of_groups": [
36       "ml-admins"
37     ],
38     "principal_on_behalf_of_email": "admin@example.com"
39   },
40   "auth_header_format": "Authorization: Bearer {{ auth_secret }}"
41 }

Update status-related fields of a model provider.

This endpoint supports partial updates for fields managed by Models Controller:

model_deployment_id
served_models
status
status_message

If status is provided without status_message, status_message will be set to empty string.

Update status-related fields of a model provider. This endpoint supports partial updates for fields managed by Models Controller: - model_deployment_id - served_models - status - status_message If status is provided without status_message, status_message will be set to empty string.

Path parameters

workspacestringRequired

namestringRequired

Request

This endpoint expects an object.

model_deployment_idstringOptional<=255 characters

Reference to the ModelDeployment ID if this provider is associated with a deployment

served_modelslist of objectsOptional

List of models served by this provider with routing information for IGW

statusenumOptional

Status of the model provider

status_messagestringOptional<=1000 characters

Status message. If status is provided without status_message, defaults to empty string.

Response

Update status-related fields of a model provider

namestringformat: "^[\w\-.]+$"<=255 characters

Name of the entity. Name/workspace combo must be unique across all entities. Allowed characters: letters (a-z, A-Z), digits (0-9), underscores, hyphens, and dots.

workspacestringformat: "^[\w\-.]+$"<=255 characters

The workspace of the entity. Allowed characters: letters (a-z, A-Z), digits (0-9), underscores, hyphens, and dots.

created_atdatetime

The timestamp of model entity creation

updated_atdatetime

The timestamp of the last model entity update

host_urlstring<=2048 characters

The network endpoint URL for the model provider

idstring

Unique identifier for the model provider

projectstringformat: "^[\w\-./]+$"<=255 characters

The URN of the project associated with this entity.

descriptionstring<=1000 characters

Optional description of the model provider

api_key_secret_namestring<=255 characters

Reference to the API key stored in Secrets service

served_modelslist of objects

List of models served by this provider with routing information for IGW

enabled_modelslist of strings

Optional list of specific models to enable from this provider. If not set, all discovered models are enabled.

statusenumDefaults to UNKNOWN

Current status of the model provider, populated by models service

status_messagestring<=1000 charactersDefaults to

Detailed status message, populated by models service

default_extra_bodymap from strings to any

Default body parameters for inference requests. Can be overridden by user requests.

default_extra_headersmap from strings to strings

Default headers for inference requests. Can be overridden by user requests.

required_extra_bodymap from strings to any

Required body parameters for inference requests. Cannot be overridden by user requests.

required_extra_headersmap from strings to strings

Required headers for inference requests. Cannot be overridden by user requests.

model_deployment_idstring<=255 characters

Optional reference to the ModelDeployment ID if this provider was auto-created for a deployment

auth_contextobject

Auth context captured at provider creation.

auth_header_formatstring<=1024 characters

Jinja2 template string controlling how the API key secret is sent to the upstream. Must contain exactly one variable named auth_secret, which is substituted with the resolved secret value at request time. Example: 'X-Api-Key: {{ auth_secret }}'. If not set, defaults to 'Authorization: Bearer {{ auth_secret }}'.

Errors

422

Unprocessable Entity Error