Customization Config#
Refer to the following table to understand the fields and settings of a given customization configuration available to your organization.
Customization configurations are created by your organization admins and define the initial parameters for a customization job, such as:
The base model to customize
The training methods supported
The fine-tuning approaches supported
The precision format
The number of GPUs and compute nodes to use
The parallelization techniques employed for the distributed training
The size of micro-batches for training
The maximum sequence length for input
An organization can have multiple customization configurations, each with different settings.
Note
For parameters that you can set at the customization job level, see the Hyperparameters reference.
Schema#
Field |
Description |
---|---|
|
Unique identifier for the config |
|
The base model to customize |
|
List of supported training methods |
|
List of supported fine-tuning approaches |
|
Model precision format (bfloat16) |
|
Number of GPUs to use for training |
|
Number of compute nodes to use |
|
Size of micro-batches for training |
|
Degree of tensor parallelism |
|
Enables sequence parallelism |
|
Maximum sequence length for input |
|
Optional custom configuration parameters |
|
Resource configuration for the training option |