morpheus.llm.services.nvfoundation_llm_service

(Latest Version)

Classes

NVFoundationLLMClient(parent, *, model_name, ...) Client for interacting with a specific model in Nemo.
NVFoundationLLMService(*[, api_key, base_url]) A service for interacting with NeMo LLM models, this class should be used to create a client for a specific model.
Previous morpheus.llm.services.nemo_llm_service.NeMoLLMService
Next morpheus.llm.services.nvfoundation_llm_service.NVFoundationLLMClient
© Copyright 2024, NVIDIA. Last updated on Jul 8, 2024.