Local LLM GPU List
| Model | Brand | Type | Memory type | Ecosystem | |||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
 Instinct MI210 | AMD | Data center | 64 | HBM2e | 1,638 | 181 | 181 | 300 | ROCm | —No listings | Mar 22, 2022 |
| Radeon PRO W7900 | AMD | Workstation | 48 | GDDR6 ECC | 864 | 123 | 123 | 295 | ROCm | —No listings | Apr 13, 2023 |
| Instinct MI100 | AMD | Data center | 32 | HBM2 | 1,229 | 92.3 | 92.3 | 300 | ROCm | —No listings | Nov 16, 2020 |
| Radeon AI PRO R9700 | AMD | Workstation | 32 | GDDR6 | 640 | 191 | 383 | 300 | ROCm | —No listings | Jul 23, 2025 |
| Radeon PRO W7800 | AMD | Workstation | 32 | GDDR6 ECC | 576 | 90.4 | 90.4 | 260 | ROCm | —No listings | Apr 13, 2023 |
| Radeon RX 7900 XTX | AMD | Consumer | 24 | GDDR6 | 960 | 123 | 123 | 355 | ROCm | —No listings | Dec 13, 2022 |
| Radeon RX 7900 XT | AMD | Consumer | 20 | GDDR6 | 800 | 103 | 103 | 315 | ROCm | —No listings | Dec 13, 2022 |
| Radeon RX 9070 XT | AMD | Consumer | 16 | GDDR6 | 640 | 195 | 389 | 304 | ROCm | —No listings | Mar 6, 2025 |
| Mac Studio M3 Ultra 512GB | Apple | Unified memory | 512 | LPDDR5X · unified memory | 819 | — | — | 480 | Metal | —No listings | Mar 12, 2025 |
| Mac Studio M3 Ultra 256GB | Apple | Unified memory | 256 | LPDDR5X · unified memory | 819 | — | — | 480 | Metal | —No listings | Mar 12, 2025 |
| Mac Studio M4 Max 128GB | Apple | Unified memory | 128 | LPDDR5X · unified memory | 546 | — | — | 480 | Metal | —No listings | Mar 12, 2025 |
 Arc Pro B65 | Intel | Workstation | 32 | GDDR6 | 608 | 98.5 | 197 | 200 | oneAPI | —No listings | Mar 25, 2026 |
| Arc Pro B70 | Intel | Workstation | 32 | GDDR6 | 608 | 183.5 | 367 | 230 | oneAPI | —No listings | Mar 25, 2026 |
| Arc Pro B60 | Intel | Workstation | 24 | GDDR6 | 456 | 98.5 | 197 | 200 | oneAPI | —No listings | Aug 1, 2025 |
 RTX PRO 5000 Blackwell 72GB | NVIDIA | Workstation | 72 | GDDR7 ECC | 1,344 | 258 | 516 | 300 | CUDA | —No listings | Aug 1, 2025 |
| GeForce RTX 4090 48GB (modded) | NVIDIA | Consumer | 48 | GDDR6X | 1,008 | 330.3 | 660.6 | 450 | CUDA | —No listings | Oct 12, 2022 |
| RTX PRO 5000 Blackwell 48GB | NVIDIA | Workstation | 48 | GDDR7 ECC | 1,344 | 258 | 516 | 300 | CUDA | —No listings | Mar 18, 2025 |
| A100 40GB PCIe | NVIDIA | Data center | 40 | HBM2 | 1,555 | 312 | 624 | 250 | CUDA | —No listings | Jun 22, 2020 |
| GeForce RTX 4080 SUPER 32GB (modded) | NVIDIA | Consumer | 32 | GDDR6X | 736 | 208.9 | 417.8 | 320 | CUDA | —No listings | Jan 31, 2024 |
| GeForce RTX 5090 | NVIDIA | Consumer | 32 | GDDR7 | 1,792 | 419 | 838 | 575 | CUDA | —No listings | Jan 30, 2025 |
| GeForce RTX 5090 D | NVIDIA | Consumer | 32 | GDDR7 | 1,792 | 296.9 | 593.8 | 575 | CUDA | —No listings | Jan 30, 2025 |
| RTX PRO 4500 Blackwell | NVIDIA | Workstation | 32 | GDDR7 ECC | 896 | 202.1 | 404.3 | 200 | CUDA | —No listings | Mar 18, 2025 |
| GeForce RTX 3090 | NVIDIA | Consumer | 24 | GDDR6X | 936 | 142.3 | 284.7 | 350 | CUDA | —No listings | Sep 24, 2020 |
| GeForce RTX 4090 | NVIDIA | Consumer | 24 | GDDR6X | 1,008 | 330.3 | 660.6 | 450 | CUDA | —No listings | Oct 12, 2022 |
| GeForce RTX 5090 D V2 | NVIDIA | Consumer | 24 | GDDR7 | 1,344 | 296.9 | 593.8 | 575 | CUDA | —No listings | Aug 15, 2025 |
| RTX PRO 4000 Blackwell | NVIDIA | Workstation | 24 | GDDR7 ECC | 672 | 161.3 | 322.5 | 145 | CUDA | —No listings | Mar 18, 2025 |
| GeForce RTX 4080 | NVIDIA | Consumer | 16 | GDDR6X | 717 | 195 | 389.9 | 320 | CUDA | —No listings | Nov 16, 2022 |
| GeForce RTX 5070 Ti | NVIDIA | Consumer | 16 | GDDR7 | 896 | 175.8 | 351.5 | 300 | CUDA | —No listings | Feb 20, 2025 |
| GeForce RTX 5080 | NVIDIA | Consumer | 16 | GDDR7 | 960 | 225.1 | 450.2 | 360 | CUDA | —No listings | Jan 30, 2025 |
Used prices are median asking prices, not sold prices · Methodology