A100 vs H100
The A100 delivers 3.2× the FP16 compute of the A100 while costing 1.0× less on average, making the H100 209% more cost-efficient per TFLOP.
Spec Comparison
Spec
A100
H100
Architecture
Ampere
Hopper
VRAM
80 GB
80 GB
FP16 TFLOPS
312
989
Memory Bandwidth
2,000 GB/s
3,350 GB/s
MSRP
$10,000
$30,000
Used/Market Price
$7,000
N/A
Live Pricing
Cost Efficiency
Metric
A100
H100
$/TFLOP/hr
$0.0273
$0.0088
$/GB-VRAM/hr
$0.1065
$0.1094
Lower $/TFLOP and $/GB-VRAM is better. Based on median hourly pricing.
Provider Availability
Both available on (11)
A100 Cloud Pricing
358 instances| Provider | GPUs | VRAM | Region | Type | Price/hr | |
|---|---|---|---|---|---|---|
| CHEAPESTVast.ai | 1x | 40 GB | EU-Central | Spot | $0.0800 | Rent |
| Vast.ai | 1x | 40 GB | EU-Central | On-Demand | $0.0934 | Rent |
| Vultr | 1x | 4 GB | ewr | On-Demand | $0.123 | Rent |
| Vultr | 1x | 4 GB | fra | On-Demand | $0.123 | Rent |
| Vultr | 1x | 4 GB | sjc | On-Demand | $0.123 | Rent |
| Vultr | 1x | 4 GB | nrt | On-Demand | $0.123 | Rent |
| Vultr | 1x | 8 GB | ewr | On-Demand | $0.247 | Rent |
| Vultr | 1x | 8 GB | nrt | On-Demand | $0.247 | Rent |
| Vultr | 1x | 8 GB | blr | On-Demand | $0.247 | Rent |
| Verda | 1x | 40 GB | EU-Central | Spot | $0.252 | Rent |
H100 Cloud Pricing
293 instances| Provider | GPUs | VRAM | Region | Type | Price/hr | |
|---|---|---|---|---|---|---|
| CHEAPESTVerda | 1x | 80 GB | EU-Central | Spot | $0.801 | Rent |
| Verda | 1x | 80 GB | EU-Central | Spot | $0.801 | Rent |
| Nebius | 1x | 80 GB | eu-north1 | Spot | $1.25 | Rent |
| GCP | 1x | 80 GB | europe-north1-c | Spot | $1.35 | Rent |
| GCP | 1x | 80 GB | EU-West | Spot | $1.45 | Rent |
| Vast.ai | 1x | 80 GB | fr-france | Spot | $1.47 | Rent |
| Vast.ai | 1x | 80 GB | fr-france | Spot | $1.47 | Rent |
| Vast.ai | 1x | 80 GB | fr-france | On-Demand | $1.47 | Rent |
| Vast.ai | 1x | 80 GB | fr-france | On-Demand | $1.57 | Rent |
| Verda | 2x | 160 GB | EU-Central | Spot | $1.60 | Rent |