NVIDIA
high
A100
- 80 GB VRAM
- HBM2e
- 2,039 GB/s
- 2020
- Best shop price
- –
- Hosting from
- 0.959 €/h
- €/GB
- –
BUY-SIDE · CONSUMER CARDS
GPUs with 40 GB VRAM or more
Graphics cards with at least 40 GB VRAM – enough for large local LLMs. Shop prices and hosting rates compared.
NVIDIA
high
A100 40GB PCIe
- 40 GB VRAM
- HBM2e
- 1,555 GB/s
- 2020
- Best shop price
- –
- Hosting from
- 0.247 €/h
- €/GB
- –
NVIDIA
mid
A40
- 48 GB VRAM
- GDDR6
- 696 GB/s
- 2021
- Best shop price
- –
- Hosting from
- 0.393 €/h
- €/GB
- –
NVIDIA
flagship
B200 SXM
- 192 GB VRAM
- HBM3e
- 8,000 GB/s
- 2024
- Best shop price
- –
- Hosting from
- 6.713 €/h
- €/GB
- –
NVIDIA
flagship
B300
- 288 GB VRAM
- HBM3e
- 8,000 GB/s
- 2025
- Best shop price
- –
- Hosting from
- 6.00 €/h
- €/GB
- –
NVIDIA
high
GeForce RTX 6000
- 48 GB VRAM
- GDDR6
- 960 GB/s
- 2022
- Best shop price
- –
- Hosting from
- 0.496 €/h
- €/GB
- –
NVIDIA
flagship
H100
- 80 GB VRAM
- HBM3
- 3,350 GB/s
- 2022
- Best shop price
- –
- Hosting from
- 1.44 €/h
- €/GB
- –
NVIDIA
flagship
H100 SXM
- 80 GB VRAM
- HBM3
- 3,350 GB/s
- 2022
- Best shop price
- –
- Hosting from
- 1.204 €/h
- €/GB
- –
NVIDIA
flagship
H200
- 141 GB VRAM
- HBM3e
- 4,800 GB/s
- 2024
- Best shop price
- –
- Hosting from
- 2.422 €/h
- €/GB
- –
NVIDIA
flagship
H200 SXM
- 141 GB VRAM
- HBM3e
- 4,800 GB/s
- 2024
- Best shop price
- –
- Hosting from
- 1.486 €/h
- €/GB
- –
NVIDIA
high
L40
- 48 GB VRAM
- GDDR6
- 864 GB/s
- 2022
- Best shop price
- –
- Hosting from
- 0.774 €/h
- €/GB
- –
NVIDIA
high
L40S
- 48 GB VRAM
- GDDR6
- 864 GB/s
- 2023
- Best shop price
- –
- Hosting from
- 0.436 €/h
- €/GB
- –
NVIDIA
high
RTX 6000 Ada Generation
- 48 GB VRAM
- GDDR6
- 960 GB/s
- 2022
- Best shop price
- –
- Hosting from
- 0.831 €/h
- €/GB
- –
NVIDIA
high
RTX A6000
- 48 GB VRAM
- GDDR6
- 768 GB/s
- 2020
- Best shop price
- –
- Hosting from
- 0.37 €/h
- €/GB
- –
RTX PRO 6000
- 96 GB VRAM
- GDDR7
- 1,792 GB/s
- 2025
- Best shop price
- 17,890.00 €
- Hosting from
- 1.343 €/h
- €/GB
- 186.350