What Do You Need to Run Kimi Locally? VRAM by Version
Kimi currently has 6 versions you can deploy locally. The smallest, Kimi Linear 48B A3B, needs 3GB of VRAM at Q4; the largest, Kimi K3, needs 33GB. The cheapest device that gets one running is the Tesla V100 16GB, at about $131.
VRAM needed for each Kimi version
Xianyu
| Version | Released | Context | |||
|---|---|---|---|---|---|
| Kimi Linear 48B A3BMoE | 49.1B (3B active) | Oct 30, 2025 | 1M | 3plus 27 GB of RAM | Tesla V100 16GB$131 · 16 GB · Experts offloaded |
| Kimi K2MoE | 1,000B (32B active) | Sep 3, 2025 | 256K | 9plus 552 GB of RAM | Tesla V100 16GB$131 · 16 GB · Experts offloaded |
| Kimi K2.5MoE | 1,000B (32B active) | Jan 1, 2026 | 256K | 9plus 552 GB of RAM | Tesla V100 16GB$131 · 16 GB · Experts offloaded |
| Kimi K2.6MoE | 1,000B (32B active) | Apr 14, 2026 | 256K | 9plus 552 GB of RAM | Tesla V100 16GB$131 · 16 GB · Experts offloaded |
| Kimi K2.7 CodeMoE | 1,000B (32B active) | Jun 12, 2026 | 256K | 9plus 552 GB of RAM | Tesla V100 16GB$131 · 16 GB · Experts offloaded |
| Kimi K3MoE | 2,800B (104B active) | Jun 13, 2026 | 1M | 33plus 1,531 GB of RAM | CMP 170HX 40GB$1,680 · 40 GB · Experts offloaded |
Minimum VRAM = Q4_K_M weights + KV cache for an 8K context + 1GB runtime overhead, rounded up. The cheapest device is the first one that fits when sorting by median price on the current price basis.
About Kimi
Kimi is published by Moonshot AI under MIT / Modified MIT / Kimi K3 License. This page covers 6 versions ranging from 49.1B to 2,800B parameters. New official releases are scanned weekly; architecture parameters and sourced or estimated weight sizes are reviewed before publication.
VendorMoonshot AI
LicenseMIT / Modified MIT / Kimi K3 License
Official sitehttps://www.moonshot.ai/
Hugging Face orgmoonshotai