A100 vs RTX4090
The A100 delivers 1.9× the FP16 compute of the RTX4090 while costing 11.6× more on average, making the RTX4090 511% more cost-efficient per TFLOP.
Spec Comparison
Spec
A100
RTX4090
Architecture
Ampere
Ada Lovelace
VRAM
80 GB
24 GB
FP16 TFLOPS
312
165
Memory Bandwidth
2,000 GB/s
1,008 GB/s
MSRP
$10,000
$1,599
Used/Market Price
$7,000
$1,200
Live Pricing
Cost Efficiency
Metric
A100
RTX4090
$/TFLOP/hr
$0.0266
$0.0044
$/GB-VRAM/hr
$0.1038
$0.0299
Lower $/TFLOP and $/GB-VRAM is better. Based on median hourly pricing.
Provider Availability
Only on RTX4090 (1)
A100 Cloud Pricing
363 instances| Provider | GPUs | VRAM | Region | Type | Price/hr | |
|---|---|---|---|---|---|---|
| CHEAPESTVast.ai | 1x | 40 GB | EU-Central | Spot | $0.0800 | Rent |
| Vast.ai | 1x | 40 GB | EU-Central | On-Demand | $0.0934 | Rent |
| Vultr | 1x | 4 GB | ewr | On-Demand | $0.123 | Rent |
| Vultr | 1x | 4 GB | fra | On-Demand | $0.123 | Rent |
| Vultr | 1x | 4 GB | sjc | On-Demand | $0.123 | Rent |
| Vultr | 1x | 4 GB | nrt | On-Demand | $0.123 | Rent |
| Vultr | 1x | 8 GB | ewr | On-Demand | $0.247 | Rent |
| Vultr | 1x | 8 GB | nrt | On-Demand | $0.247 | Rent |
| Vultr | 1x | 8 GB | blr | On-Demand | $0.247 | Rent |
| Verda | 1x | 40 GB | EU-Central | Spot | $0.252 | Rent |
RTX4090 Cloud Pricing
96 instances| Provider | GPUs | VRAM | Region | Type | Price/hr | |
|---|---|---|---|---|---|---|
| CHEAPESTVast.ai | 1x | 24 GB | Spot | $0.131 | Rent | |
| RunPod | 1x | 24 GB | CA | Spot | $0.200 | Rent |
| RunPod | 1x | 24 GB | FR | Spot | $0.200 | Rent |
| RunPod | 1x | 24 GB | SE | Spot | $0.200 | Rent |
| RunPod | 1x | 24 GB | SK | Spot | $0.200 | Rent |
| RunPod | 1x | 24 GB | TT | Spot | $0.200 | Rent |
| RunPod | 1x | 24 GB | US | Spot | $0.200 | Rent |
| RunPod | 1x | 24 GB | EU-RO-1 | Spot | $0.290 | Rent |
| RunPod | 1x | 24 GB | EUR-IS-2 | Spot | $0.290 | Rent |
| RunPod | 1x | 24 GB | US-CA-2 | Spot | $0.290 | Rent |