core.inference.apis

Submodules

• core.inference.apis.async_llm
• core.inference.apis.serve_config
• core.inference.apis._llm_base
• core.inference.apis.llm

Package Contents

Data

__all__

API

core.inference.apis.__all__

[‘DynamicInferenceRequest’, ‘DynamicInferenceRequestRecord’, ‘MegatronAsyncLLM’, ‘MegatronLLM’, ‘Sam…