NVIDIA
mid
A10
- 24 GB VRAM
- GDDR6
- 600 GB/s
- 2021
- Best shop price
- –
- Hosting from
- 1.592 €/h
- €/GB
- –
BUY-SIDE · CONSUMER CARDS
GPUs with 24 GB VRAM or more
Graphics cards with at least 24 GB VRAM – enough for large local LLMs. Shop prices and hosting rates compared.
NVIDIA
high
A100
- 80 GB VRAM
- HBM2e
- 2,039 GB/s
- 2020
- Best shop price
- –
- Hosting from
- 1.335 €/h
- €/GB
- –
NVIDIA
high
A100 40GB PCIe
- 40 GB VRAM
- HBM2e
- 1,555 GB/s
- 2020
- Best shop price
- –
- Hosting from
- 1.727 €/h
- €/GB
- –
NVIDIA
mid
A30
- 24 GB VRAM
- HBM2
- 933 GB/s
- 2021
- Best shop price
- –
- Hosting from
- 1.226 €/h
- €/GB
- –
NVIDIA
mid
A40
- 48 GB VRAM
- GDDR6
- 696 GB/s
- 2021
- Best shop price
- –
- Hosting from
- 0.393 €/h
- €/GB
- –
NVIDIA
flagship
B200 SXM
- 192 GB VRAM
- HBM3e
- 8,000 GB/s
- 2024
- Best shop price
- –
- Hosting from
- 6.706 €/h
- €/GB
- –
NVIDIA
flagship
B300
- 288 GB VRAM
- HBM3e
- 8,000 GB/s
- 2025
- Best shop price
- –
- Hosting from
- 6.00 €/h
- €/GB
- –
NVIDIA
enthusiast
GeForce RTX 3090
- 24 GB VRAM
- GDDR6X
- 936 GB/s
- 2020
- Best shop price
- –
- Hosting from
- 0.101 €/h
- €/GB
- –
NVIDIA
enthusiast
GeForce RTX 3090 Ti
- 24 GB VRAM
- GDDR6X
- 1,008 GB/s
- 2022
- Best shop price
- –
- Hosting from
- 0.112 €/h
- €/GB
- –
GeForce RTX 4090
- 24 GB VRAM
- GDDR6X
- 1,008 GB/s
- 2022
- Best shop price
- 212.01 €
- Hosting from
- 0.179 €/h
- €/GB
- 8.830
GeForce RTX 5090
- 32 GB VRAM
- GDDR7
- 1,792 GB/s
- 2025
- Best shop price
- 8,299.00 €
- Hosting from
- 0.28 €/h
- €/GB
- 259.340
NVIDIA
flagship
H100
- 80 GB VRAM
- HBM3
- 3,350 GB/s
- 2022
- Best shop price
- –
- Hosting from
- 2.232 €/h
- €/GB
- –
NVIDIA
flagship
H200
- 141 GB VRAM
- HBM3e
- 4,800 GB/s
- 2024
- Best shop price
- –
- Hosting from
- 3.18 €/h
- €/GB
- –
NVIDIA
entry
L4
- 24 GB VRAM
- GDDR6
- 300 GB/s
- 2023
- Best shop price
- –
- Hosting from
- 0.493 €/h
- €/GB
- –
NVIDIA
high
L40
- 48 GB VRAM
- GDDR6
- 864 GB/s
- 2022
- Best shop price
- –
- Hosting from
- 0.774 €/h
- €/GB
- –
NVIDIA
high
L40S
- 48 GB VRAM
- GDDR6
- 864 GB/s
- 2023
- Best shop price
- –
- Hosting from
- 0.886 €/h
- €/GB
- –
RTX 5000 Ada Generation
- 32 GB VRAM
- GDDR6
- 576 GB/s
- 2023
- Best shop price
- 4,999.00 €
- Hosting from
- –
- €/GB
- 156.220
NVIDIA
high
RTX 6000 Ada Generation
- 48 GB VRAM
- GDDR6
- 960 GB/s
- 2022
- Best shop price
- –
- Hosting from
- 0.605 €/h
- €/GB
- –
NVIDIA
mid
RTX A5000
- 24 GB VRAM
- GDDR6
- 768 GB/s
- 2021
- Best shop price
- –
- Hosting from
- 0.179 €/h
- €/GB
- –
NVIDIA
high
RTX A6000
- 48 GB VRAM
- GDDR6
- 768 GB/s
- 2020
- Best shop price
- –
- Hosting from
- 0.37 €/h
- €/GB
- –
RTX PRO 6000
- 96 GB VRAM
- GDDR7
- 1,792 GB/s
- 2025
- Best shop price
- 17,890.00 €
- Hosting from
- 0.972 €/h
- €/GB
- 186.350
NVIDIA
entry
V100
- 32 GB VRAM
- HBM2
- 900 GB/s
- 2017
- Best shop price
- –
- Hosting from
- 0.122 €/h
- €/GB
- –