nemo_microservices.types.model_artifact_de_param#
Module Contents#
Classes#
API#
- class nemo_microservices.types.model_artifact_de_param.ModelArtifactDeParam#
Bases:
typing_extensions.TypedDict- backend_engine: nemo_microservices.types.backend_engine_type_de.BackendEngineTypeDe#
None
Types of backend engine.
- files_url: typing_extensions.Required[str]#
None
The location where the artifact files are stored.
- gpu_arch: str#
None
- precision: nemo_microservices.types.model_precision_de.ModelPrecisionDe#
None
Types of model precision.
- status: typing_extensions.Required[nemo_microservices.types.artifact_status_de.ArtifactStatusDe]#
None
The status of the model artifact.
- tensor_parallelism: int#
None