A100 vs T4
The A100 delivers 4.8× the FP16 compute of the T4 while costing 9.1× more on average, making the T4 90% more cost-efficient per TFLOP.
Spec Comparison
Spec
A100
T4
Architecture
Ampere
Older
VRAM
80 GB
16 GB
FP16 TFLOPS
312
65
Memory Bandwidth
2,000 GB/s
320 GB/s
MSRP
$10,000
N/A
Used/Market Price
$7,000
$1,500
Live Pricing
Cost Efficiency
Metric
A100
T4
$/TFLOP/hr
$0.0266
$0.0140
$/GB-VRAM/hr
$0.1038
$0.0568
Lower $/TFLOP and $/GB-VRAM is better. Based on median hourly pricing.
Provider Availability
Only on A100 (11)
Only on T4 (5)
A100 Cloud Pricing
363 instances| Provider | GPUs | VRAM | Region | Type | Price/hr | |
|---|---|---|---|---|---|---|
| CHEAPESTVast.ai | 1x | 40 GB | EU-Central | Spot | $0.0800 | Rent |
| Vast.ai | 1x | 40 GB | EU-Central | On-Demand | $0.0934 | Rent |
| Vultr | 1x | 4 GB | ewr | On-Demand | $0.123 | Rent |
| Vultr | 1x | 4 GB | fra | On-Demand | $0.123 | Rent |
| Vultr | 1x | 4 GB | sjc | On-Demand | $0.123 | Rent |
| Vultr | 1x | 4 GB | nrt | On-Demand | $0.123 | Rent |
| Vultr | 1x | 8 GB | ewr | On-Demand | $0.247 | Rent |
| Vultr | 1x | 8 GB | nrt | On-Demand | $0.247 | Rent |
| Vultr | 1x | 8 GB | blr | On-Demand | $0.247 | Rent |
| Verda | 1x | 40 GB | EU-Central | Spot | $0.252 | Rent |
T4 Cloud Pricing
1557 instances| Provider | GPUs | VRAM | Region | Type | Price/hr | |
|---|---|---|---|---|---|---|
| CHEAPESTAzure | 1x | 16 GB | Asia-Pacific | Spot | $0.0684 | Rent |
| Azure | 1x | 16 GB | US-Central | Spot | $0.0686 | Rent |
| Azure | 1x | 16 GB | Asia-Pacific | Spot | $0.0977 | Rent |
| Azure | 1x | 16 GB | US-Central | Spot | $0.0980 | Rent |
| GCP | 1x | 16 GB | me-west1-b | Spot | $0.112 | Rent |
| GCP | 1x | 16 GB | me-west1-c | Spot | $0.112 | Rent |
| GCP | 1x | 16 GB | EU-West | Spot | $0.117 | Rent |
| GCP | 1x | 16 GB | me-west1-b | Spot | $0.118 | Rent |
| GCP | 1x | 16 GB | me-west1-c | Spot | $0.118 | Rent |
| AWS | 1x | 16 GB | South America | Spot | $0.123 | Rent |