- class NeMoLLMService(*, api_key=None, org_id=None, retry_count=5)[source]
Bases:
morpheus.llm.services.llm_service.LLMServiceA service for interacting with NeMo LLM models, this class should be used to create a client for a specific model.
Methods
get_client(*, model_name, **model_kwargs)Returns a client for interacting with a specific model. - get_client(*, model_name, **model_kwargs)[source]
Returns a client for interacting with a specific model. This method is the preferred way to create a client.
- Parameters
- model_name
- model_kwargs
The name of the model to create a client for.
Additional keyword arguments to pass to the model when generating text.
morpheus.llm.services.nemo_llm_service.NeMoLLMService
Previous
morpheus.llm.services.nemo_llm_service.NeMoLLMClient
Next
morpheus.llm.services.openai_chat_service