Is this page helpful?

nemo_microservices.types.customization.customization_config_with_warning_message#

Module Contents#

Classes#

CustomizationConfigWithWarningMessage

Data#

Target

API#

class nemo_microservices.types.customization.customization_config_with_warning_message.CustomizationConfigWithWarningMessage(/, **data: typing.Any)#

Bases: nemo_microservices._models.BaseModel

chat_prompt_template: Optional[str]#

None

Chat Prompt Template to apply to the model to make it compatible with chat datasets, or to train it on a different template for your use case.

This parameter is only used for the "SFT" and "Distillation" Training Types on non embedding models.
created_at: Optional[datetime.datetime]#

None

Timestamp for when the entity was created.

custom_fields: Optional[Dict[str, object]]#

None

A set of custom fields that the user can define and use for various purposes.

dataset_schemas: Optional[List[Dict[str, object]]]#

None

JSON Schema used for validating datasets that can be used with the configured finetuning jobs.

description: Optional[str]#

None

The description of the entity.

max_seq_length: int#

None

The largest context used for training.

Datasets are truncated based on the maximum sequence length.

name: Optional[str]#

None

The name of the entity.

Must be unique inside the namespace. If not specified, it will be the same as the automatically generated id.

namespace: Optional[str]#

None

The namespace of the entity.

This can be missing for namespace entities or in deployments that don’t use namespaces.

ownership: Optional[nemo_microservices.types.shared.ownership.Ownership]#

None

Information about ownership of an entity.

If the entity is a namespace, the access_policies will typically apply to all entities inside the namespace.

pod_spec: Optional[nemo_microservices.types.training_pod_spec.TrainingPodSpec]#

None

Additional parameters to ensure these training jobs get run on the appropriate hardware.

project: Optional[str]#

None

The URN of the project associated with this entity.

prompt_template: Optional[str]#

None

Prompt template used to extract keys from the dataset. E.g.

prompt_template=’{input} {output}’, and sample looks like ‘{“input”: “Q: 2x2 A:”, “output”: “4”}’ then the model sees ‘Q: 2x2 A: 4’.

This parameter is only used for the "SFT" and "Distillation" Training Types on non embeddding models.
target: Optional[nemo_microservices.types.customization.customization_config_with_warning_message.Target]#

None

The target to perform the customization on

training_options: List[nemo_microservices.types.customization_training_option.CustomizationTrainingOption]#

None

Resource configuration for each training option for the model.

training_precision: Optional[nemo_microservices.types.shared.model_precision.ModelPrecision]#

None

Type of model precision.

Values

  • "int8" - 8-bit integer precision

  • "bf16" - Brain floating point precision

  • "fp16" - 16-bit floating point precision

  • "fp32" - 32-bit floating point precision

  • "fp8-mixed" - Mixed 8-bit floating point precision available on Hopper and later architectures.

  • "bf16-mixed" - Mixed Brain floating point precision

updated_at: Optional[datetime.datetime]#

None

Timestamp for when the entity was last updated.

warning_message: Optional[str]#

None

Warning message when updating the customization config

nemo_microservices.types.customization.customization_config_with_warning_message.Target: typing_extensions.TypeAlias#

None