PTuningParameters

class nemo_microservices.types.customization.PTuningParameters(*args: Any, **kwargs: Any)

Bases: BaseModel

virtual_tokens: int

Number of virtual tokens to use for customization.

Virtual tokens are embeddings inserted into the model prompt that have no concrete mapping to strings or characters within the model’s vocabulary.