UCF Registry

In this section, we explain how UCF Registry and repositories in the registry are organized. Repositories can be local or remote on NGC. Developers can interact with the repositories using the UCF Tools (CLI/Studio).

Microservice Contents

UCF microservice contains the following artifacts:

  • UCF Microservice Specification

  • Helm chart

  • Container Image/s

  • Any other artifacts like DeepLearning Models and Configurations

Local Repository

Local repository is basically a file based repository created on the host file system.

When a microservice is built it is added to the local repository. The generated UCF Microservice Specification gets stored in this local repository. Based on the mode of microservice creation and build (Refer to Generate scaffolding), Helm Chart and Container Images maybe built and stored locally or maybe used from a remote location.

It is up to the microservice developer on how/where the other artifacts like Models and Configurations are stored and retrieved during deployment.

Note

Users can use the local (default) repository to store microservices.

NGC Repository

Currently, UCF supports NGC as the remote repository. NGC is a NVIDIA provided catalog service for containers, pre-trained models, Helm charts for Kubernetes deployments and industry specific AI toolkits with software development kits (SDKs).

UCF uses NGC as a platform for it’s various repositories where it stores the containers, helm charts and the UCF Microservice Specification for the various microservices.

A UCF NGC repository is basically a Private NGC Registry with a specified org and team.

Multiple such use case/product-specific repositories have been created. Each UCF NGC repository contains artifacts specific to the use case/product. It contains:

  • UCF Microservice Specification for the various microservices used in the use case/product.

  • Helm Chart for the microservices

  • Container Images may be uploaded to the same private NGC repository. However this is OPTIONAL.

  • Other artifacts like Models and Configurations may be uploaded to the same private NGC repository. However this is OPTIONAL.

It is up to the microservice developer on how/where the Container Images and other artifacts like Models and Configurations are stored and retrieved during deployment.

Note

Users cannot create new NGC based repositories and hence they can use the local (default) repository to store microservices.

List of UCF Repositories

A list of Repositories that are part of the UCF Registry is uploaded to NGC public catalog. The tools can retrieve this list without any API keys.

Current list of UCF Repositories is:

  • UCF

  • Tokkio

  • ACE

  • Metropolis

Note

Not all above repositories are accessible to everyone. Only accessible repositories are visible in repo list. Please request access to the repositories from corresponding programs.

When a user sets the NGC API Key, the UCF tools verifies the accessible repositories and populates the repo list.

For example:

  • User A might have access to the UCF repository but not the Tokkio repository and hence User A will only see and interact with UCF repository

  • User B might have access to both the UCF repository and the Tokkio repository and hence User A will see and interact with both UCF and Tokkio repositories

The UCF Repository

The UCF Repository consists of microservices required for building the UCF Reference Applications. It consists of the following microservices:

  • ucf.svc.botmaker.dialog-manager

  • ucf.svc.botmaker.speech-controller

  • ucf.svc.botmaker.speech-web-app

  • ucf.svc.botmaker.text-web-app

  • ucf.svc.riva.speech-skills

For the UCF Repository, all artifacts (microservice specifications, helm charts, container images, models, etc.,) have been added to the same private NGC registry and hence having access to just the one UCF private NGC registry is enough to get the UCF reference apps working.

The Tokkio Repository

The Tokkio Repository consists of microservices required for building the Tokkio Application. It consists of the following microservices:

  • ucf.svc.botmaker.answer-rewriter

  • ucf.svc.botmaker.dialog-manager

  • ucf.svc.botmaker.speech-controller

  • ucf.svc.core.mongodb

  • ucf.svc.core.redis

  • ucf.svc.core.redis-timeseries

  • ucf.svc.ds.visionai

  • ucf.svc.maxine.anim-a2f

  • ucf.svc.maxine.audio

  • ucf.svc.metropolis.occupancy-alerts

  • ucf.svc.metropolis.occupancy-alerts-api

  • ucf.svc.riva.speech-skills

  • ucf.svc.tokkio.cart-manager

  • ucf.svc.tokkio.fulfillment-food-ordering

  • ucf.svc.tokkio.ingress-mgr

  • ucf.svc.tokkio.menu-api

  • ucf.svc.tokkio.mlops-data-collector

  • ucf.svc.tokkio.thinclient

  • ucf.svc.tokkio.ui-server

  • ucf.svc.vms

For the Tokkio Repository, the microservice specifications and helm charts are part of the UCF Tokkio repository. Other artifacts like container images, models, etc., are part of the NV Tokkio 1.5 private NGC registry.

Hence access to both UCF Tokkio private NGC registry and NV Tokkio 1.5 private NGC registry is required to get the UCF Tokkio App working.

Extending the UCF Repository List

The UCF Repository list can be easily extended for other use cases / products like ACE, MDX without having any changes in the tools. This would involve:

  • Creating a new use case / product specific private NGC team under nv-ucf org for hosting the Microservice Specifications and Helm charts

  • Depending on use case / product, other artifacts like Container Images, Models etc., may be uploaded to the same private NGC team or maybe uploaded elsewhere

  • Update the list of Repositories with the new repository and upload to NGC.

With the same unchanged build of tools, whenever user sets the NGC API Key, this updated list of repositories will be fetched and the new repository will be accessible to the user (if the user has been added to the corresponding private NGC team).