- class LLMService[source]
Bases:
abc.ABCAbstract interface for services which are able to construct clients for interacting with LLM models.
Methods
get_client(*, model_name, **model_kwargs)Returns a client for interacting with a specific model. - abstract get_client(*, model_name, **model_kwargs)[source]
Returns a client for interacting with a specific model.
- Parameters
- model_name
- model_kwargs
The name of the model to create a client for.
Additional keyword arguments to pass to the model.
morpheus.llm.services.llm_service.LLMService
Previous
morpheus.llm.services.llm_service.LLMClient
Next
morpheus.llm.services.nemo_llm_service