nemo_microservices.types.v2.evaluation.model_v2_param#

Module Contents#

Classes#

ModelV2Param

API#

class nemo_microservices.types.v2.evaluation.model_v2_param.ModelV2Param#

Bases: typing_extensions.TypedDict

api_endpoint: nemo_microservices.types.shared_params.api_endpoint_data.APIEndpointData#

None

Data about an API endpoint.

artifact: nemo_microservices.types.shared_params.model_artifact.ModelArtifact#

None

Data about a model artifact (a set of checkpoint files, configs, and other auxiliary info).

The files_url field can point to a DataStore location.

Example:

  • nds://models/rdinu/my-lora-customization

The rdinu/my-lora-customization part above is the actual repository.

If a specific revision needs to be referred, the HuggingFace syntax is used.

  • nds://models/rdinu/my-lora-customization@v1

  • nds://models/rdinu/my-lora-customization@8df79a8

base_model: str | Dict[str, object]#

None

Link to another model which is used as a base for the current model.

guardrails: nemo_microservices.types.shared_params.guardrail_config_param.GuardrailConfigParam#

None

A guardrail configuration

peft: nemo_microservices.types.shared_params.parameter_efficient_finetuning_data.ParameterEfficientFinetuningData#

None

Data about a parameter-efficient finetuning.

prompt: nemo_microservices.types.shared_params.prompt_data.PromptData#

None

Prompt engineering data.

spec: nemo_microservices.types.shared_params.model_spec.ModelSpec#

None

Detailed specification about a model.