H100 vs T4
The H100 delivers 15.2× the FP16 compute of the T4 while costing 9.9× more on average, making it 54% more cost-efficient per TFLOP.
Spec Comparison
Spec
H100
T4
Architecture
Hopper
Older
VRAM
80 GB
16 GB
FP16 TFLOPS
989
65
Memory Bandwidth
3,350 GB/s
320 GB/s
MSRP
$30,000
N/A
Used/Market Price
N/A
$1,500
Live Pricing
Cost Efficiency
Metric
H100
T4
$/TFLOP/hr
$0.0091
$0.0140
$/GB-VRAM/hr
$0.1121
$0.0568
Lower $/TFLOP and $/GB-VRAM is better. Based on median hourly pricing.
Provider Availability
Both available on (5)
Only on H100 (31)
H100 Cloud Pricing
327 instances| Provider | GPUs | VRAM | Region | Type | Price/hr | |
|---|---|---|---|---|---|---|
| CHEAPESTVerda | 1x | 80 GB | EU-Central | Spot | $0.801 | Rent |
| Verda | 1x | 80 GB | EU-Central | Spot | $0.801 | Rent |
| Nebius | 1x | 80 GB | eu-north1 | Spot | $1.25 | Rent |
| GCP | 1x | 80 GB | europe-north1-c | Spot | $1.29 | Rent |
| GCP | 1x | 80 GB | EU-West | Spot | $1.39 | Rent |
| Vast.ai | 1x | 80 GB | fr-france | Spot | $1.47 | Rent |
| Vast.ai | 1x | 80 GB | fr-france | On-Demand | $1.55 | Rent |
| Verda | 2x | 160 GB | EU-Central | Spot | $1.60 | Rent |
| Shadeform | 1x | 80 GB | US-East | On-Demand | $1.66 | Rent |
| E2E Networks | 1x | 80 GB | Asia-Pacific | On-Demand | $1.69 | Rent |
T4 Cloud Pricing
1557 instances| Provider | GPUs | VRAM | Region | Type | Price/hr | |
|---|---|---|---|---|---|---|
| CHEAPESTAzure | 1x | 16 GB | Asia-Pacific | Spot | $0.0684 | Rent |
| Azure | 1x | 16 GB | US-Central | Spot | $0.0686 | Rent |
| Azure | 1x | 16 GB | Asia-Pacific | Spot | $0.0977 | Rent |
| Azure | 1x | 16 GB | US-Central | Spot | $0.0980 | Rent |
| GCP | 1x | 16 GB | me-west1-b | Spot | $0.112 | Rent |
| GCP | 1x | 16 GB | me-west1-c | Spot | $0.112 | Rent |
| GCP | 1x | 16 GB | EU-West | Spot | $0.117 | Rent |
| GCP | 1x | 16 GB | me-west1-b | Spot | $0.118 | Rent |
| GCP | 1x | 16 GB | me-west1-c | Spot | $0.118 | Rent |
| AWS | 1x | 16 GB | South America | Spot | $0.123 | Rent |