VRAMGlass contains affiliate links. As an eBay Partner, we may be compensated if you make a purchase.As an eBay Partner, we may be compensated.Learn more

GPUs tracked57Price history49 daysPrice points (24h)43,303 pointsBiggest 24h dropGeForce RTX 3060 12GB-11.1%Biggest 24h riseCMP 170HX 40GB+19.8%Updated
$ USD

What Do You Need to Run Qwen Locally? VRAM by Version

Qwen currently has 8 versions you can deploy locally. The smallest, Qwen3 8B, needs 8GB of VRAM at 4-bit; the largest, Qwen3.8 2.4T A95B, is an MoE model and needs 29GB of VRAM plus about 1,286GB of RAM with MoE offloading. The cheapest device that gets one running is the Tesla V100 16GB, at about $370.

VersionReleasedContextLicense
Qwen3.8 Flash NextMoEAug 26, 2026176B6B256KQwen Community License 1.0
Qwen3.8 27BDenseAug 14, 202627.8B27.8B256KApache-2.0
Qwen3.8 2.4T A95BMoEAug 12, 20262,446B95B256KQwen3.8-Max License
Qwen3.6 27BDenseApr 22, 202627.8B27.8B256KApache-2.0
Qwen3.6 35B A3BMoEApr 16, 202636B3B256KApache-2.0
Qwen3.5 9BDenseMar 2, 20269.7B9.7B256KApache-2.0
Qwen3 32BDenseApr 27, 202532.8B32.8B40KApache-2.0
Qwen3 8BDenseApr 27, 20258.2B8.2B40KApache-2.0

About Qwen

Qwen is Alibaba's large model family (Alibaba was founded in Hangzhou in 1999). Qwen launched in 2023, and that August Alibaba open-sourced Qwen-7B with commercial use allowed. Since then the family has been mostly open-weight, with sizes ranging from under 1B up to a trillion parameters, in both dense and MoE designs. According to Hugging Face's summer 2026 report, there are 151,448 derivative models based on Qwen, the most of any developer.

The past two years brought several turning points. Qwen3, in April 2025, switched to the Apache 2.0 license and can toggle between thinking and non-thinking modes. Qwen3-Next, that September, moved to a hybrid architecture that combines linear attention (Gated DeltaNet) with gated attention, and Qwen3.5, in February 2026, kept that architecture while becoming natively multimodal. From late 2025, flagship versions stopped getting open weights for a while (Qwen3.7-Max, for example, is available only through an API), while small and mid-size models stayed open source. Qwen3.8 2.4T A95B, in August 2026, brought open flagship weights back, but under a custom license with conditions on commercial use.

  • VendorAlibaba
  • Versions8
  • Parameters8.2B – 2,446B
  • Latest versionQwen3.8 Flash Next
License
Apache-2.0 / Qwen Community License 1.0 / Qwen3.8-Max License
Official site
qwen.ai
Hugging Face org
Qwen

How much VRAM do Qwen models need at 2-bit?

2-bit, also called Q2, covers common GGUF files such as Q2_K and UD-Q2_K_XL. They are the smallest and lose the most quality, which makes them a way to get a model running first when VRAM is tight. Each row in the table below is a Qwen version and each column is a context length; each cell is the total VRAM needed to deploy it at Q2 (weights + KV cache + 1.1GB runtime overhead).

VersionWeightsGB32K contextGB128K contextGB256K contextGB1M contextGB
Qwen3.8 Flash Next176B (6B active)78.9GGUF80.883.286.4—
Qwen3.8 27B27.8B9.8GGUF1319.528.1—
Qwen3.8 2.4T A95B2,446B (95B active)730.7GGUF734.9744.1756.5—
Qwen3.6 27B27.8B11.8GGUF1521.530.1—
Qwen3.6 35B A3B36B (3B active)12.3GGUF1416.118.7—
Qwen3.5 9B9.7B4.1GGUF6.29.513.8—
Qwen3 32B32.8B12.8GGUF22.5———
Qwen3 8B8.2B3.5GGUF9.4———

How much VRAM do Qwen models need at 4-bit?

4-bit, also called Q4, corresponds to the widely used Q4_K_M files, which balance size and quality and are the default choice for local deployment. Each row in the table below is a Qwen version and each column is a context length; each cell is the total VRAM needed to deploy it at Q4.

VersionWeightsGB32K contextGB128K contextGB256K contextGB1M contextGB
Qwen3.8 Flash Next176B (6B active)111.3GGUF113.2115.6118.8—
Qwen3.8 27B27.8B16.5GGUF19.726.234.8—
Qwen3.8 2.4T A95B2,446B (95B active)1,310.9GGUF1,315.11,324.31,336.7—
Qwen3.6 27B27.8B16.8GGUF2026.535.1—
Qwen3.6 35B A3B36B (3B active)22.1GGUF23.825.928.5—
Qwen3.5 9B9.7B5.7GGUF7.811.115.4—
Qwen3 32B32.8B19.8GGUF29.5———
Qwen3 8B8.2B5GGUF10.9———

How much VRAM do Qwen models need at 8-bit?

8-bit, also called Q8, corresponds to Q8_0 files, which come closest to the original in quality and are also the largest. Each row in the table below is a Qwen version and each column is a context length; each cell is the total VRAM needed to deploy it at Q8.

VersionWeightsGB32K contextGB128K contextGB256K contextGB1M contextGB
Qwen3.8 Flash Next176B (6B active)188.2GGUF190.1192.5195.7—
Qwen3.8 27B27.8B29GGUF32.238.747.3—
Qwen3.8 2.4T A95B2,446B (95B active)2,600.2GGUF2,604.42,613.62,626—
Qwen3.6 27B27.8B28.6GGUF31.838.346.9—
Qwen3.6 35B A3B36B (3B active)36.9GGUF38.640.743.3—
Qwen3.5 9B9.7B9.5GGUF11.614.919.2—
Qwen3 32B32.8B34.8GGUF44.5———
Qwen3 8B8.2B8.7GGUF14.6———

FAQ

Is Qwen open source and free for commercial use?

For most versions, yes. Qwen3 8B, Qwen3 32B, Qwen3.5 9B, Qwen3.6 27B, Qwen3.6 35B A3B and Qwen3.8 27B are all Apache 2.0, so you can use them commercially, fine-tune them and redistribute them, as long as you include the license, keep the copyright notices and mark any files you changed. There are two exceptions, and both attach conditions to commercial use. Qwen3.8 Flash Next uses the Qwen Community License 1.0. If you use it in a commercial product with more than 100 million monthly active users or monthly revenue above the threshold, you must prominently display the model name in the interface. In addition, any company (including its affiliates) that runs a model-as-a-service business, or builds a standalone assistant product focused mainly on AI coding or office work, must apply to Qwen for a separate license before commercial use, regardless of size. Qwen3.8 2.4T A95B uses the Qwen3.8-Max License, which has the same attribution requirement, but its separate-license clause applies only to companies in those two lines of business whose revenue over 12 consecutive months exceeds the threshold. Both licenses state that the separate-license clause doesn't apply if you use the model only internally and don't offer its capabilities to third parties.

Can you run Qwen with Ollama?

Every version except the 2.4T flagship has official tags: qwen3:8b, qwen3:32b, qwen3.5:9b, qwen3.6:27b, qwen3.6:35b-a3b and qwen3.8:27b. The Qwen3.8 Flash Next library has no latest tag, so you have to write the tag out in full, such as qwen3.8-flash-next:125b-a6b-q4_K_M. Ollama names it 125B because it doesn't count the separate 51B of lookup tables; the 176B figure on this site includes them. Qwen3.8 2.4T A95B has neither a local nor a cloud version on Ollama. To run it, use llama.cpp with unsloth's GGUFs, or run the official weights on vLLM.

Other model families