VRAMGlass contains affiliate links. As an eBay Partner, we may be compensated if you make a purchase. As an Amazon Associate I earn from qualifying purchases.We may earn from eBay and Amazon links.Learn more

GPUs tracked64Price history73 daysPrice points (24h)30,087 pointsBiggest 24h dropCMP 170HX 64GB-10.8%Biggest 24h riseRadeon PRO W7800+33.6%Updated
$ USD

L40S Price, 48GB VRAM & Local LLMs

NVIDIA's L40S (2023) is a 48GB VRAM card built for servers that answer many users at once, and it runs 30B-class MoE models at about 131 tokens/s. It has no fan, and an ordinary workstation can't keep it cool.

eBay

L40S price history

Current$10,1270.00%
eBay
Price updated
$16,737$13,750$10,763$7,775$4,788
Low $6,495High $15,030
Sep 22Oct 18Nov 14

As an eBay Partner, VRAMGlass may be compensated if you buy through the eBay links on this page. The price you pay stays the same.

L40S VRAM & full specs

  • Memory48 GB · GDDR6
  • Bandwidth864 GB/s
  • FP16 / BF16362.1 TFLOPS
  • FP8 / INT8733 / 733 TOPS
Bus width
384-bit
Architecture
Ada Lovelace (AD102)
Cores
18,176
Tensor cores
568
Ecosystem
CUDA
Interface
PCIe 4.0 x16
NVLink
Not supported
Power
350 W
Power connector
16-pin
Slots
2
Length
267 mm
Type
Data center
Launch date
Aug 8, 2023

Best L40S deals

Powered by VRAMGlass real-time price tracking — handpicking the best-value hardware deals across the web

Picked from

As an eBay Partner, VRAMGlass may be compensated if you buy through the eBay links on this page. The price you pay stays the same.

Picked from

As an Amazon Associate I earn from qualifying purchases. The price you pay stays the same.

What LLMs can a single L40S run?

A single L40S fits up to 35B at 8-bit, but bandwidth is modest: 27B dense at 4-bit gets only 30-odd tokens/s, while 30B-class MoE holds 100 at 8-bit.

ModelSizeRuns?Speed t/sMax context
Gemma 4 12B12B7.1 GBRuns80.2256K
Gemma 4 26B A4B25.2B (3.8B active)16.9 GBRuns113.3256K
Qwen3.6 27B27.8B16.8 GBRuns36.8256K
Qwen3.8 27B27.8B16.5 GBRuns37.4256K
GLM 4.7 Flash30B (3B active)18.3 GBRuns128.4198K
Gemma 4 31B30.7B18.3 GBRuns33.2256K
Qwen3.6 35B A3B36B (3B active)22.1 GBRuns131.4256K

RunsFits fully in VRAM; speed is estimated from VRAM bandwidth.

Needs RAM offloadMoE only: expert weights sit in system RAM, so speed is estimated from 70 GB/s RAM bandwidth.

Too bigWon’t fit on one card at this quantization, even with RAM offload.

Full calculation rules are on the Methodology page.

What LLMs can multiple L40S cards run?

Four L40S cards (192GB) run DeepSeek V4 Flash at 4-bit at about 64 tokens/s, and two suit gpt-oss 120B. They usually come in fours or eights, with no NVLink.

ModelSizeCardsTotal priceTotal VRAMSpeed t/sTotal power
Qwen3.8 Flash Next176B (6B active)111.3 GB4 cards$40,508192 GB90.71,400 W
DeepSeek V4 Flash284B (13B active)155.1 GB4 cards$40,508192 GB64.31,400 W
Hy3295B (21B active)182.2 GB8 cards$81,016384 GB312,800 W
GLM 5.3 Flash320B (18B active)199.7 GB8 cards$81,016384 GB45.62,800 W

Full calculation rules are on the Methodology page.

Who it suits

Good fit

  1. You want 27B to 31B dense models at 8-bit

    Qwen3.8 27B at 8-bit can use the full 256K, at about 22 tokens/s

  2. You already have a GPU server that takes four to eight cards

    Four cards total 192GB, enough for DeepSeek V4 Flash at 4-bit

  3. You want FP8 in vLLM

    Ada supports FP8 compute, so FP8 models get a real speedup

Not a good fit

  1. Going into a regular desktop or tower workstation

    It has no fan and overheats without server-grade airflow

  2. Driving a monitor as your main card

    The four DP ports are disabled from the factory, and you need NVIDIA's tool to switch modes

  3. Running 2026's big MoE models on one card

    48GB can't hold even Qwen3.8 Flash Next at 2-bit, so you need at least two

Before you buy

  1. Servers only

    The L40S has no fan and relies on strong front-to-back airflow through a server chassis. On the NVIDIA developer forums, someone who put one in a Dell Precision 7875 workstation saw it hit 100°C at idle, and replies agreed it isn't suited to workstations. Before buying, check server vendors' compatibility lists; Lenovo's SR650 V3 and SR675 V3, for example, are both on them.

  2. No power cable in the box

    Power comes through a single 16-pin connector, at 350W under full load. The card doesn't come with a power cable; Lenovo's product guide specifies that the cable is ordered separately, with a length matched to the server model (from 200 to 450 mm). If you're buying a card pulled from a server, be especially sure your server has the matching cable.

  3. Video output is disabled by default

    The card has four DP ports, disabled at the factory; you need to switch display modes with NVIDIA's displaymodeselector tool before you can connect a monitor. Using it purely as a compute card isn't affected.

  4. Don't mix it up with the L40

    The L40 and L40S share the same chip and the same 48GB, but the L40S has more compute and draws 350W. Used listings often mix the two up, so look for the S in the model name.

Compared with similar GPUs

L40S vs RTX 6000 Ada, A100 80GB PCIe, and RTX PRO 5000 48GB: price, VRAM, bandwidth, compute and local LLM speed compared.

SpecL40SRTX 6000 AdaA100 80GB PCIeRTX PRO 5000 48GB
Memory
48 GB
48 GBSame
80 GB67% more
48 GBSame
Bandwidth
864 GB/s
960 GB/s11% higher
1,935 GB/s124% higher
1,344 GB/s56% higher
BF16 / FP16 compute
362 TFLOPS
364 TFLOPSSame
312 TFLOPS14% lower
258 TFLOPS29% lower
INT8 compute
733 TOPS
729 TOPSSame
624 TOPS15% lower
516 TOPS30% lower
Qwen3.8 27B speed (2-bit)
60.3 t/s
66.3 t/s10% faster
122.2 t/s103% faster
89.5 t/s48% faster
Largest dense model (4-bit)
79B
79BSame
136B72% more
79BSame
Power
350 W
300 W14% lower
300 W14% lower
300 W14% lower
GPU interconnect
Not supported
Not supported
NVLink 600 GB/s
Not supported
Interface
PCIe 4.0 x16
PCIe 4.0 x16
PCIe 4.0 x16
PCIe 5.0 x16
Released
2023-08
2022-09
2021-06
2025-03
eBay median

As an eBay Partner, VRAMGlass may be compensated if you buy through the eBay links on this page. The price you pay stays the same.

L40S rental price per hour

On-demand rental of the L40S starts at $0.79 per hour (RunPod), about $192/month at 8 hours a day. Buying one (eBay median asking price $10,127) pays off in about 9.5 years, 4.8 years or 1.6 years at 4, 8 or 24 hours a day.

OptionPrice4 h/day8 h/day24 h/dayView
RunPodRentUpdated 19 min. ago$0.79/hr$96/mo$192/mo$577/moRent
Vast.aiRentUpdated 19 min. ago$0.8/hr$98/mo$195/mo$585/moRent
eBayUpdated 2 hr. ago$10,127Payback ~9.5 yrsPower $8/moPayback ~4.8 yrsPower $15/moPayback ~1.6 yrsPower $46/moBuy

Break-even uses the US residential average ($0.18/kWh) and 350 W rated power, excluding resale value and the rest of the build.

Rental links are referral links: we may receive a commission or credit if you sign up through them. As an eBay Partner, VRAMGlass may be compensated if you buy through the eBay links on this page. The price you pay stays the same.

Other markets

Amazon.jp · Japan
N/A
No listings
View
Xianyu · Mainland China
N/A
No listings
View