nemo_microservices.types.model_ev_param#

Module Contents#

Classes#

API#

class nemo_microservices.types.model_ev_param.ModelEvParam#

Bases: typing_extensions.TypedDict

api_endpoint: nemo_microservices.types.shared_params.api_endpoint_data.APIEndpointData#

None

Data about an API endpoint.

artifact: nemo_microservices.types.shared_params.model_artifact.ModelArtifact#

None

Data about a model artifact (a set of checkpoint files, configs, and other auxiliary info).

The files_url field can point to a DataStore location.

Example:

  • nds://models/rdinu/my-lora-customization

The rdinu/my-lora-customization part above is the actual repository.

If a specific revision needs to be referred, the HuggingFace syntax is used.

  • nds://models/rdinu/my-lora-customization@v1

  • nds://models/rdinu/my-lora-customization@8df79a8

base_model: Union[str, Dict[str, object]]#

None

Link to another model which is used as a base for the current model.

created_at: typing_extensions.Annotated[Union[str, datetime.datetime], PropertyInfo(format='iso8601')]#

None

Timestamp for when the entity was created.

custom_fields: Dict[str, object]#

None

A set of custom fields that the user can define and use for various purposes.

description: str#

None

The description of the entity.

guardrails: nemo_microservices.types.shared_params.guardrail_config.GuardrailConfig#

None

A guardrail configuration

id: str#

None

The ID of the entity.

With the exception of namespaces, this is always a semantically-prefixed base58-encoded uuid4 [-base58(uuid4())].

model_providers: nemo_microservices._types.SequenceNotStr[str]#

None

List of ModelProvider namespace/name resource names that provide inference for this Model Entity

name: str#

None

The name of the entity.

Must be unique inside the namespace. If not specified, it will be the same as the automatically generated id.

namespace: str#

None

The namespace of the entity.

This can be missing for namespace entities or in deployments that don’t use namespaces.

ownership: nemo_microservices.types.shared_params.ownership.Ownership#

None

Information about ownership of an entity.

If the entity is a namespace, the access_policies will typically apply to all entities inside the namespace.

peft: nemo_microservices.types.shared_params.parameter_efficient_finetuning_data.ParameterEfficientFinetuningData#

None

Data about a parameter-efficient finetuning.

project: str#

None

The URN of the project associated with this entity.

prompt: nemo_microservices.types.shared_params.prompt_data.PromptData#

None

Prompt engineering data.

schema_version: str#

None

The version of the schema for the object. Internal use only.

spec: nemo_microservices.types.shared_params.model_spec.ModelSpec#

None

Detailed specification about a model.

type_prefix: str#

None

updated_at: typing_extensions.Annotated[Union[str, datetime.datetime], PropertyInfo(format='iso8601')]#

None

Timestamp for when the entity was last updated.

version_id: str#

None

A unique, immutable id for the version. This is similar to the commit hash.

version_tags: Iterable[nemo_microservices.types.shared_params.version_tag.VersionTag]#

None

The list of version tags associated with this entity.