RTX PRO 6000 Blackwell: 96GB VRAM — What Local LLMs Can It Run?
Check prices
The RTX PRO 6000 Blackwell has 96GB of GDDR7 ECC memory with 1,792 GB/s of bandwidth. No used-price data yet. At Q4 quantization it runs models up to 70B parameters at roughly 30 tokens/s.
Full RTX PRO 6000 Blackwell specifications
What LLMs can the RTX PRO 6000 Blackwell run?
One reference model per family (its main version)| Model | Q4_K_M | Q8_0 | FP16 | ||||||
|---|---|---|---|---|---|---|---|---|---|
| Fits | Speed t/s | Context | Fits | Speed t/s | Context | Fits | Speed t/s | Context | |
| DeepSeekDeepSeek R1 Qwen3 8B | ✓ | 201.2 | 128K | ✓ | 122.4 | 128K | ✓ | 69.9 | 128K |
| GemmaGemma 4 31B | ✓ | 55.6 | 32K | ✓ | 33.1 | 32K | ✓ | 18.6 | 32K |
| GLMGLM 4.7 Flash | ✓ | 180.9 | 128K | ✓ | 149.3 | 128K | ✓ | 111.8 | 128K |
| gpt-ossgpt-oss 20B | ✓ | 172.9 | 128K | ✓ | 139.1 | 128K | ✓ | 101.1 | 128K |
| KimiKimi Linear 48B A3B | ✓ | 185.6 | 128K | ✓ | 152.4 | 128K | Offload | 14.9 | — |
| LlamaLlama 3.1 8B | ✓ | 206.3 | 128K | ✓ | 125.2 | 128K | ✓ | 71.4 | 128K |
| MistralMistral 7B v0.3 | ✓ | 222.6 | 32K | ✓ | 136.5 | 32K | ✓ | 78.4 | 32K |
| QwenQwen3 8B | ✓ | 201.2 | 32K | ✓ | 122.4 | 32K | ✓ | 69.9 | 32K |
Fits when weights + KV cache + runtime overhead is at or below usable memory, single card. "Offload" on MoE models means it runs with expert weights in system RAM (only attention layers and KV cache stay in VRAM); that speed assumes 70 GB/s RAM bandwidth. The context column is the largest tier that fits.
RTX PRO 6000 Blackwell used price history
Not enough history to draw a chart yet — price tracking just started.
Prices by platform
Buy links may carry affiliate tags; they do not change the price you pay.
FAQ
How much VRAM does the RTX PRO 6000 Blackwell have?
The RTX PRO 6000 Blackwell has 96GB of GDDR7 ECC memory with 1,792 GB/s of bandwidth.
Can the RTX PRO 6000 Blackwell run a 70B model?
Yes. At Q4_K_M with an 8K context a 70B dense model needs about 43GB, which fits in the RTX PRO 6000 Blackwell's 96GB.
How much does a used RTX PRO 6000 Blackwell cost?
No used-price data yet; it will appear here once the feed is live.