GPUs tracked56Price history27 daysPrice points (24h)34,228 pointsBiggest 24h dropA100 80GB PCIe-20.0%Biggest 24h riseRTX PRO 5000 48GB+17.5%Updated
$ USD
English

Tesla P40 Price & Used Prices: Which Local LLMs Can It Run?

The Tesla P40 has 24GB of GDDR5 memory with 347 GB/s of bandwidth. The median asking price is about $179 on Xianyu. At 4-bit quantization and 8K context it fits a dense model of up to about 37B parameters, at roughly 11 tokens/s.

Tesla P40 price history

Price updated
$192$186$180$174$168
Low $171High $189
Sep 23Sep 26Sep 29

Buy links may carry affiliate tags; they do not change the price you pay.

Full Tesla P40 specifications

  • Memory24 GB · GDDR5
  • Bandwidth347 GB/s
  • INT847 TOPS
Bus width
384-bit
Architecture
Pascal (GP102)
Cores
3,840
Ecosystem
CUDA
Interface
PCIe 3.0 x16
NVLink
Not supported
Power
250 W
Power connector
8-pin CPU (EPS-12V)
Slots
2
Length
267 mm
Type
Data center
Launch date
Sep 13, 2016

What LLMs can the Tesla P40 run?

Models up to 50B parameters on a single Tesla P40, versions released since 2026 only

ModelSizeRuns?Speed t/sMax context
Gemma 4 E4B8B5 GBRuns48.3128K
Qwen3.5 9B9.7B5.7 GBRuns42.3256K
Gemma 4 12B12B7.1 GBRuns33.9256K
Gemma 4 26B A4B25.2B (3.8B active)16.9 GBRuns68256K
Qwen3.6 27B27.8B16.8 GBRuns14.8117K
Qwen3.8 27B27.8B16.5 GBRuns15122K
GLM 4.7 Flash30B (3B active)18.3 GBRuns83.2115K
Gemma 4 31B30.7B18.3 GBRuns13.366K
Qwen3.6 35B A3B36B (3B active)22.1 GBRuns86.6123K

RunsFits fully in VRAM; speed is estimated from VRAM bandwidth.

Needs RAM offloadMoE only: expert weights sit in system RAM, so speed is estimated from 70 GB/s RAM bandwidth.

Too bigWon’t fit on one card at this quantization, even with RAM offload.

Dual, 4x and 8x Tesla P40 for LLMs: which models fit?

Cards needed for 50B+ models released since 2026, with vLLM tensor parallelism at 32K context

ModelSizeCardsTotal priceTotal VRAMSpeed t/sTotal power
Qwen3.8 Flash Next176B (6B active)111.3 GB8 cards$1,428192 GB492,000 W
DeepSeek V4 Flash284B (13B active)155.1 GB8 cards$1,428192 GB31.12,000 W

Card counts are 1 / 2 / 4 / 8, each using 90% of its VRAM. Speed is based on one card’s bandwidth; price covers GPUs only. No NVLink; cards talk over PCIe. Whether it runs also depends on vLLM support.

Tesla P40 rental price per hour

On Compshare, the Tesla P40 rents for $0.06 per hour on demand, about $14/month at 8 hours a day. Buying one (Xianyu median $179) pays off in about 10.6 years, 5.3 years or 1.8 years at 4, 8 or 24 hours a day.

OptionPrice4 h/day8 h/day24 h/dayView
CompshareRentUpdated 41 min. ago$0.06/hr$7/mo$14/mo$41/moRent
XianyuUpdated 3 hr. ago$179Payback ~10.6 yrsPower $5/moPayback ~5.3 yrsPower $11/moPayback ~1.8 yrsPower $33/moBuy

Break-even uses the US residential average ($0.18/kWh) and 250 W rated power, excluding resale value and the rest of the build.

Other markets

eBay · United States
$397
16 listings
View
Amazon.jp · Japan
N/A
No listings
View

Buy links may carry affiliate tags; they do not change the price you pay.

FAQ

How large a model can the Tesla P40 run?

A single Tesla P40 has 24GB of GDDR5 VRAM. At 4-bit quantization and 8K context it fits a dense model of up to about 37B parameters, or about 20B at 8-bit.

Can the Tesla P40 run a 70B model?

Not on a single card. At 4-bit with an 8K context a 70B dense model needs about 43GB, more than the Tesla P40's 24GB. It runs if you split the layers across 2 cards with llama.cpp (48GB total).

What are the best LLMs to run on the Tesla P40?

Among models released in 2026, the largest dense model that fits entirely in VRAM at 4-bit is Gemma 4 31B, at an estimated 13.3 tokens/s. Among MoE models, Qwen3.6 35B A3B is the fastest at about 86.6 tokens/s. The full list is in the table above.

How many tokens per second does the Tesla P40 get on LLMs?

Estimated from memory bandwidth at 4-bit and 8K context: 8B dense: about 46.2 tokens/s, 14B dense: about 27.4 tokens/s, and 32B dense: about 12.5 tokens/s. MoE models read only the active parameters for each token, so they run much faster. Real-world results are usually 70%–100% of the estimate.

What LLMs can dual Tesla P40 cards run?

With vLLM tensor parallelism at 4-bit and 32K context, two Tesla P40 cards cannot fit any model of 50B or larger released in 2026. At 4-bit with 32K context the minimum is 8 cards, which fits Qwen3.8 Flash Next and DeepSeek V4 Flash.

How much does a Tesla P40 cost?

As of Sep 29, 2026: eBay median $397 (16 listings) and Xianyu median $179 (13 listings). Figures are medians of live listings, refreshed every 6 hours.

Is the Tesla P40 price going up or down?

As of Sep 29, 2026, the Xianyu median is down 4.4% over 7 days, down 4.4% over 30 days.

How much does it cost to rent a Tesla P40 per hour?

As of Sep 29, 2026: Compshare at $0.06 per hour. All are single-GPU on-demand rates, excluding storage and data transfer.

Is it cheaper to buy or rent a Tesla P40 at 8 hours a day?

Taking the Xianyu median of $179 and electricity at $0.18 per kWh, at 8 hours a day buying pays for itself in about 5.3 years (versus Compshare at $0.06 per hour). If you will use it for longer than 5.3 years, buy; otherwise, rent.

Tesla P40 vs Tesla T10: which is better for LLMs?

The Tesla T10 has 16GB of VRAM and 403 GB/s of bandwidth; the Tesla P40 has 24GB and 347 GB/s. At the Xianyu median, the Tesla T10 costs about $199, 11.2% more than the Tesla P40 ($179). For 14B dense models at 4-bit, the Tesla P40 is estimated at about 27.4 tokens/s and the Tesla T10 at about 31.7 tokens/s.