nemo_microservices.types.v2.evaluation.model_v2

Module Contents

Classes

ModelV2

API

class nemo_microservices.types.v2.evaluation.model_v2.ModelV2(/, **data: typing.Any)

Bases: nemo_microservices._models.BaseModel

api_endpoint: Optional[nemo_microservices.types.shared.api_endpoint_data.APIEndpointData]

None

Data about an API endpoint.

artifact: Optional[nemo_microservices.types.shared.model_artifact.ModelArtifact]

None

Data about a model artifact (a set of checkpoint files, configs, and other auxiliary info).

The files_url field can point to a DataStore location.

Example:

• nds://models/rdinu/my-lora-customization

The rdinu/my-lora-customization part above is the actual repository.

If a specific revision needs to be referred, the HuggingFace syntax is used.

• nds://models/rdinu/my-lora-customization@v1

• nds://models/rdinu/my-lora-customization@8df79a8

base_model: Union[str, Dict[str, object], None]

None

Link to another model which is used as a base for the current model.

guardrails: Optional[nemo_microservices.types.shared.guardrail_config.GuardrailConfig]

None

A guardrail configuration

peft: Optional[nemo_microservices.types.shared.parameter_efficient_finetuning_data.ParameterEfficientFinetuningData]

None

Data about a parameter-efficient finetuning.

prompt: Optional[nemo_microservices.types.shared.prompt_data.PromptData]

None

Prompt engineering data.

spec: Optional[nemo_microservices.types.shared.model_spec.ModelSpec]

None

Detailed specification about a model.