Kimi-K3

Kimi-K3 is a Moonshot AI vision-language model with a MoonViT3d vision tower and a Kimi Linear Mixture-of-Experts language backbone.

Set up NeMo AutoModel with the latest container or follow the installation instructions.

Fine-Tune Kimi-K3

From the repository root, run:

uv run automodel --nproc-per-node=8 examples/llm_finetune/kimi/k3_hellaswag.yaml

Choose a Workflow

Model Reference

Model Architecture

• KimiK3ForConditionalGeneration combines the MoonViT3d vision tower and multimodal projector with the Kimi Linear language backbone.
• KimiK3ForCausalLM exposes the text-only Kimi Linear backbone.

Available Models

Related Resources

• LLM Fine-Tuning Guide
• VLM Fine-Tuning Guide