GeForce RTX 4090 48GB Price & Used Prices: Which Local LLMs Can It Run?
The GeForce RTX 4090 48GB has 48GB of GDDR6X memory with 1,008 GB/s of bandwidth. No price data yet. At Q4 quantization it runs models up to 70B parameters at roughly 17 tokens/s.
GeForce RTX 4090 48GB price history
eBay
Full GeForce RTX 4090 48GB specifications
What LLMs can the GeForce RTX 4090 48GB run?
Versions released since 2026 with up to 50B parameters| Model | 2-bit | 4-bit | 8-bit | ||||||
|---|---|---|---|---|---|---|---|---|---|
| Fits | Speed t/s | Context | Fits | Speed t/s | Context | Fits | Speed t/s | Context | |
| GemmaGemma 4 E4B | ✓ | 179.4 | 128K | ✓ | 129.4 | 128K | ✓ | 75.3 | 128K |
| QwenQwen3.5 9B | ✓ | 149.1 | 128K | ✓ | 107.5 | 128K | ✓ | 62.5 | 128K |
| GemmaGemma 4 12B | ✓ | 106.8 | 32K | ✓ | 79.4 | 32K | ✓ | 47.9 | 32K |
| GemmaGemma 4 26B A4B | ✓ | 133.6 | 128K | ✓ | 116.8 | 128K | ✓ | 88.2 | 32K |
| QwenQwen3.6 27B | ✓ | 58.2 | 128K | ✓ | 40.6 | 32K | ✓ | 22.8 | 32K |
| QwenQwen3.8 27B | ✓ | 58.2 | 128K | ✓ | 40.6 | 32K | ✓ | 22.8 | 32K |
| GLMGLM 4.7 Flash | ✓ | 169.3 | 128K | ✓ | 148.9 | 128K | ✓ | 113.6 | 128K |
| GemmaGemma 4 31B | ✓ | 43.6 | 32K | ✓ | 31.9 | 8K | ✓ | 18.8 | 8K |
| QwenQwen3.6 35B A3B | ✓ | 165.1 | 128K | ✓ | 145.6 | 128K | ✓ | 111.7 | 32K |
Fits when weights + KV cache + runtime overhead is at or below usable memory, single card. "Offload" on MoE models means it runs with expert weights in system RAM (only attention layers and KV cache stay in VRAM); that speed assumes 70 GB/s RAM bandwidth. The context column is the largest tier that fits.
Prices by platform
Buy links may carry affiliate tags; they do not change the price you pay.
FAQ
How much VRAM does the GeForce RTX 4090 48GB have?
The GeForce RTX 4090 48GB has 48GB of GDDR6X memory with 1,008 GB/s of bandwidth.
Can the GeForce RTX 4090 48GB run a 70B model?
Yes. At Q4_K_M with an 8K context a 70B dense model needs about 43GB, which fits in the GeForce RTX 4090 48GB's 48GB.
How much does a GeForce RTX 4090 48GB cost?
No price data yet; it will appear here once the feed is live.