Update an existing Customization Config

Options

API

1. Submit a PATCH request to /v1/customization/configs/{namespace}/{name}.

   cURL

   curl -X PATCH "${CUSTOMIZER_SERVICE_URL}/v1/customization/configs/default/llama-3.1-8b-instruct@v1.0.0+A100" \
     -H 'accept: application/json' \
     -H 'Content-Type: application/json' \
     -d '{
      "description": "Updated description",
      "max_seq_length: 4096
     }' | jq
   

2. Review the response.

   Example Response

   {
    "created_at": "2024-11-26T02:58:55.339737",
    "updated_at": "2024-11-26T03:58:55.339737",
    "namespace": "default",
    "name": "customization_config-MedVscVbr4pgLhLgKTLbv9",
    "description": "Updated description",
    "target": "meta/llama-3.1-8b-instruct@2.0",
    "training_options": [
        {
            "training_type": "sft",
            "finetuning_type": "lora",
            "num_gpus": 2,
            "num_nodes": 1,
            "tensor_parallel_size": 1,
            "micro_batch_size": 1,
        },
    ],
    "training_precision": "bf16",
    "max_seq_length": 4096,
    "pod_spec": "{ object }",
    "prompt_template": "string",
    "chat_prompt_template": "string",
    "dataset_schemas": "{ object }",
    "project": "string",
    "ownership": "{ object }"
   }