Skip to main content

H100 vs RTX4090

The H100 delivers 6.0× the FP16 compute of the RTX4090 while costing 12.5× more on average, making the RTX4090 108% more cost-efficient per TFLOP.

Spec Comparison

Spec
H100
RTX4090
Architecture
Hopper
Ada Lovelace
VRAM
80 GB
24 GB
FP16 TFLOPS
989
165
Memory Bandwidth
3,350 GB/s
1,008 GB/s
MSRP
$30,000
$1,599
Used/Market Price
N/A
$1,200

Live Pricing

H100
Cheapest
$0.801/hr
Median
$8.97/hr
Average
$16/hr
Providers
36
Instances
327
RTX4090
Cheapest
$0.131/hr
Median
$0.718/hr
Average
$1.01/hr
Providers
3
Instances
96

Cost Efficiency

Metric
H100
RTX4090
$/TFLOP/hr
$0.0091
$0.0044
$/GB-VRAM/hr
$0.1121
$0.0299

Lower $/TFLOP and $/GB-VRAM is better. Based on median hourly pricing.

Provider Availability

H100 Cloud Pricing

327 instances
ProviderGPUsVRAMRegionTypePrice/hr
CHEAPESTVerda1x80 GBEU-CentralSpot$0.801Rent
Verda1x80 GBEU-CentralSpot$0.801Rent
Nebius1x80 GBeu-north1Spot$1.25Rent
GCP1x80 GBeurope-north1-cSpot$1.29Rent
GCP1x80 GBEU-WestSpot$1.39Rent
Vast.ai1x80 GBfr-franceSpot$1.47Rent
Vast.ai1x80 GBfr-franceOn-Demand$1.55Rent
Verda2x160 GBEU-CentralSpot$1.60Rent
Shadeform1x80 GBUS-EastOn-Demand$1.66Rent
E2E Networks1x80 GBAsia-PacificOn-Demand$1.69Rent

RTX4090 Cloud Pricing

96 instances
ProviderGPUsVRAMRegionTypePrice/hr
CHEAPESTVast.ai1x24 GBSpot$0.131Rent
RunPod1x24 GBCASpot$0.200Rent
RunPod1x24 GBFRSpot$0.200Rent
RunPod1x24 GBSESpot$0.200Rent
RunPod1x24 GBSKSpot$0.200Rent
RunPod1x24 GBTTSpot$0.200Rent
RunPod1x24 GBUSSpot$0.200Rent
RunPod1x24 GBEU-RO-1Spot$0.290Rent
RunPod1x24 GBEUR-IS-2Spot$0.290Rent
RunPod1x24 GBUS-CA-2Spot$0.290Rent

Compare with Other GPUs

RTX4090 vs ...