morpheus.llm.services.nemo_llm_service

Classes

NeMoLLMClient(parent, *, model_name, ...) Client for interacting with a specific model in Nemo.
NeMoLLMService(*[, api_key, org_id, retry_count]) A service for interacting with NeMo LLM models, this class should be used to create a client for a specific model.
Previous morpheus.llm.services.llm_service.LLMService
Next morpheus.llm.services.nemo_llm_service.NeMoLLMClient
© Copyright 2024, NVIDIA. Last updated on Apr 25, 2024.