A100 vs H200
The A100 delivers 6.3× the FP16 compute of the A100 while costing 1.4× less on average, making the H200 340% more cost-efficient per TFLOP.
Spec Comparison
Spec
A100
H200
Architecture
Ampere
Hopper
VRAM
80 GB
141 GB
FP16 TFLOPS
312
1,979
Memory Bandwidth
2,000 GB/s
4,800 GB/s
MSRP
$10,000
$40,000
Used/Market Price
$7,000
N/A
Live Pricing
Cost Efficiency
Metric
A100
H200
$/TFLOP/hr
$0.0266
$0.0060
$/GB-VRAM/hr
$0.1038
$0.0849
Lower $/TFLOP and $/GB-VRAM is better. Based on median hourly pricing.
Provider Availability
Only on A100 (7)
Only on H200 (2)
A100 Cloud Pricing
363 instances| Provider | GPUs | VRAM | Region | Type | Price/hr | |
|---|---|---|---|---|---|---|
| CHEAPESTVast.ai | 1x | 40 GB | EU-Central | Spot | $0.0800 | Rent |
| Vast.ai | 1x | 40 GB | EU-Central | On-Demand | $0.0934 | Rent |
| Vultr | 1x | 4 GB | ewr | On-Demand | $0.123 | Rent |
| Vultr | 1x | 4 GB | fra | On-Demand | $0.123 | Rent |
| Vultr | 1x | 4 GB | sjc | On-Demand | $0.123 | Rent |
| Vultr | 1x | 4 GB | nrt | On-Demand | $0.123 | Rent |
| Vultr | 1x | 8 GB | ewr | On-Demand | $0.247 | Rent |
| Vultr | 1x | 8 GB | nrt | On-Demand | $0.247 | Rent |
| Vultr | 1x | 8 GB | blr | On-Demand | $0.247 | Rent |
| Verda | 1x | 40 GB | EU-Central | Spot | $0.252 | Rent |
H200 Cloud Pricing
133 instances| Provider | GPUs | VRAM | Region | Type | Price/hr | |
|---|---|---|---|---|---|---|
| CHEAPESTVerda | 1x | 141 GB | EU-Central | Spot | $1.19 | Rent |
| Nebius | 1x | 141 GB | eu-north1 | Spot | $1.45 | Rent |
| Nebius | 1x | 141 GB | EU-West | Spot | $1.45 | Rent |
| Nebius | 1x | 141 GB | US-Central | Spot | $1.45 | Rent |
| RunPod | 1x | 141 GB | US-East | Spot | $2.29 | Rent |
| RunPod | 1x | 141 GB | EU-FR-1 | Spot | $2.29 | Rent |
| RunPod | 1x | 141 GB | EUR-IS-2 | Spot | $2.29 | Rent |
| RunPod | 1x | 141 GB | EUR-IS-4 | Spot | $2.29 | Rent |
| RunPod | 1x | 141 GB | US-CA-2 | Spot | $2.29 | Rent |
| RunPod | 1x | 141 GB | US-GA-2 | Spot | $2.29 | Rent |