deepseek-llm-7b-chat
deepseek-llm-7b-chat
DeepSeek is a series of open-weight language models from DeepSeek AI. The first-generation models (V1/V2) use standard transformer decoder and Multi-head Latent Attention architectures.
Use this page as a checkpoint and architecture reference. Set up NeMo AutoModel with the latest container or follow the installation instructions.
Model Reference
Model Architecture
DeepseekForCausalLM- DeepSeek v1/v2 dense models