VRAMGlass contains affiliate links. As an eBay Partner, we may be compensated if you make a purchase.As an eBay Partner, we may be compensated.Learn more

GPUs tracked57Price history49 daysPrice points (24h)39,704 pointsBiggest 24h dropRadeon RX 7900 XTX-3.8%Biggest 24h riseCMP 170HX 40GB+19.8%Updated
$ USD

GeForce RTX 4090 Price & Used Prices: Which Local LLMs Can It Run?

The RTX 4090 is NVIDIA's 2022 24GB flagship gaming card, running Qwen3.8 27B at 4-bit at about 43 tokens/s. Some used ones lack a chip; test under load.

eBay

GeForce RTX 4090 price history

Current$3,758+0.21%
eBay
Price updated
$6,425$5,156$3,887$2,617$1,348
Low $2,073High $5,700
Sep 5Sep 28Oct 21

As an eBay Partner, VRAMGlass may be compensated if you buy through the eBay links on this page. The price you pay stays the same.

Full GeForce RTX 4090 specifications

  • Memory24 GB · GDDR6X
  • Bandwidth1,008 GB/s
  • FP16 / BF16330.3 TFLOPS
  • FP8 / INT8660.6 / 660.6 TOPS
Bus width
384-bit
Architecture
Ada Lovelace (AD102)
Cores
16,384
Tensor cores
512
Ecosystem
CUDA
Interface
PCIe 4.0 x16
NVLink
Not supported
Power
450 W
Power connector
16-pin 12VHPWR
Slots
3
Length
304 mm
Type
Consumer
Launch date
Oct 12, 2022
MSRP
$1,599

Best GeForce RTX 4090 deals on eBay

Hand-picked deals from trusted eBay sellers. Shop with confidence.

As an eBay Partner, VRAMGlass may be compensated if you buy through the eBay links on this page. The price you pay stays the same.

What LLMs can a single GeForce RTX 4090 run?

One RTX 4090 fits up to 35B-class at 4-bit, 27B at about 43 tokens/s, with little room left for context. 8-bit fits only 12B-class.

ModelSizeRuns?Speed t/sMax context
Gemma 4 E4B8B5 GBRuns125.5128K
Qwen3.5 9B9.7B5.7 GBRuns111.8256K
Gemma 4 12B12B7.1 GBRuns91.9256K
Gemma 4 26B A4B25.2B (3.8B active)16.9 GBRuns121.4256K
Qwen3.6 27B27.8B16.8 GBRuns42.6117K
Qwen3.8 27B27.8B16.5 GBRuns43.3122K
GLM 4.7 Flash30B (3B active)18.3 GBRuns136.1115K
Gemma 4 31B30.7B18.3 GBRuns38.466K
Qwen3.6 35B A3B36B (3B active)22.1 GBRuns139123K

RunsFits fully in VRAM; speed is estimated from VRAM bandwidth.

Needs RAM offloadMoE only: expert weights sit in system RAM, so speed is estimated from 70 GB/s RAM bandwidth.

Too bigWon’t fit on one card at this quantization, even with RAM offload.

Full calculation rules are on the Methodology page.

What LLMs can multiple GeForce RTX 4090 cards run?

Two 4090s suit 48B-class MoE; four (96GB) are needed for Qwen3.8 Flash Next at 2-bit, and DeepSeek V4 Flash takes eight. The 4090 has no NVLink.

ModelSizeCardsTotal priceTotal VRAMSpeed t/sTotal power
Qwen3.8 Flash Next176B (6B active)111.3 GB8 cards$30,064192 GB98.83,600 W
DeepSeek V4 Flash284B (13B active)155.1 GB8 cards$30,064192 GB71.43,600 W

Full calculation rules are on the Methodology page.

Who it suits

Good fit

  1. Running 27B to 31B dense models on one card

    Qwen3.8 27B at 4-bit runs at about 43 tokens/s with 122K of context, and Gemma 4 31B at about 38

  2. Fitting a 30B-class MoE model entirely on the card

    Qwen3.6 35B A3B at 4-bit runs at about 139 tokens/s, and GLM 4.7 Flash at about 136

  3. Regularly feeding it long documents or batched requests

    2.3 times the compute of a 3090, plus FP8 support

Not a good fit

  1. Single-user chat only

    Generation speed depends on bandwidth, which is only 8% higher than the 3090's, so the same dense model runs only about 7% faster

  2. Running 27B models at 8-bit

    Qwen3.8 27B needs 29 GB at 8-bit, so you would need the 32GB 5090

  3. Using NVLink across two cards

    The 40 series dropped NVLink, so cards can only talk over PCIe

Before you buy

  1. Watch out for cards stripped of their GPU

    In China, large numbers of 4090s have had their GPU and memory removed to build dual-slot blower cards or 48GB cards. As a result, the used market has seen 4090s that are just empty boards, or even carry fake chips, and repair shops outside China have reported them many times. When inspecting a card, always power it on and run it at full load, and use nvidia-smi to confirm the model and the 24GB of VRAM. Don't go by photos alone.

  2. Seat the 12VHPWR plug all the way

    In late 2022 NVIDIA received about 50 reports of melted connectors, and its investigation concluded that the main cause was plugs not fully inserted. Gamers Nexus's testing found the same thing: if the plug isn't fully seated, or the cable is pulled at an angle after it is plugged in, the plug can back out a few millimeters and heat up. So push it in until there is no gap on any side, avoid sharp bends right at the plug, and don't keep unplugging it to check, which actually makes it more likely to work loose. On a used card, first check the connector for yellowing or scorch marks.

  3. Power supply and size

    For the 450W 4090, NVIDIA recommends an 850W power supply. The Founders Edition is three slots thick and 304 mm long, and many partner cards are thicker, taking up as many as four slots. Measure your case and your motherboard's slot spacing before you build.

  4. China also has a 4090 D

    The 4090 D, launched in China in late 2023, is a cut-down version: about 10% fewer cores and 425W of power, with the same 24GB of VRAM and the same bandwidth. Generation speed is basically the same as the 4090, while long prompts are processed slightly slower. Check which version a listing is for.

Compared with similar GPUs

GeForce RTX 4090 vs GeForce RTX 3090, GeForce RTX 5090, and GeForce RTX 4090 48GB: price, VRAM, bandwidth, compute and local LLM speed compared.

SpecGeForce RTX 4090GeForce RTX 3090GeForce RTX 5090GeForce RTX 4090 48GB
Memory
24 GB
24 GBSame
32 GB33% more
48 GB100% more
Bandwidth
1,008 GB/s
936 GB/s7% lower
1,792 GB/s78% higher
1,008 GB/sSame
BF16 / FP16 compute
330 TFLOPS
142 TFLOPS57% lower
419 TFLOPS27% higher
330 TFLOPSSame
INT8 compute
661 TOPS
285 TOPS57% lower
838 TOPS27% higher
661 TOPSSame
Qwen3.8 27B speed (2-bit)
69.3 t/s
64.8 t/s6% slower
114.6 t/s65% faster
69.3 t/sSame
Largest dense model (4-bit)
37B
37BSame
51B38% more
79B114% more
Power
450 W
350 W22% lower
575 W28% higher
450 WSame
GPU interconnect
Not supported
NVLink 112.5 GB/s
Not supported
Not supported
Interface
PCIe 4.0 x16
PCIe 4.0 x16
PCIe 5.0 x16
PCIe 4.0 x16
Released
2022-10
2020-09
2025-01
2022-10
eBay median

As an eBay Partner, VRAMGlass may be compensated if you buy through the eBay links on this page. The price you pay stays the same.

GeForce RTX 4090 rental price per hour

On-demand rental of the GeForce RTX 4090 starts at $0.34 per hour (RunPod), about $83/month at 8 hours a day. Buying one (eBay median $3,758) pays off in about 9.9 years, 5 years or 1.7 years at 4, 8 or 24 hours a day.

OptionPrice4 h/day8 h/day24 h/dayView
RunPodRentUpdated 47 min. ago$0.34/hr$41/mo$83/mo$248/moRent
Vast.aiRentUpdated 47 min. ago$0.62/hr$75/mo$151/mo$452/moRent
eBayUpdated 6 hr. ago$3,758Payback ~9.9 yrsPower $10/moPayback ~5 yrsPower $20/moPayback ~1.7 yrsPower $59/moBuy

Break-even uses the US residential average ($0.18/kWh) and 450 W rated power, excluding resale value and the rest of the build.

Rental links are referral links: we may receive a commission or credit if you sign up through them. As an eBay Partner, VRAMGlass may be compensated if you buy through the eBay links on this page. The price you pay stays the same.

Other markets

Amazon.jp · Japan
$5,449
9 listings
View
Xianyu · Mainland China
$3,736
6 listings
View