Skip to main content

H200 vs RTX4090

The H200 delivers 12.0× the FP16 compute of the RTX4090 while costing 16.7× more on average, making the RTX4090 39% more cost-efficient per TFLOP.

Spec Comparison

Spec
H200
RTX4090
Architecture
Hopper
Ada Lovelace
VRAM
141 GB
24 GB
FP16 TFLOPS
1,979
165
Memory Bandwidth
4,800 GB/s
1,008 GB/s
MSRP
$40,000
$1,599
Used/Market Price
N/A
$1,200

Live Pricing

H200
Cheapest
$1.19/hr
Median
$12/hr
Average
$33/hr
Providers
9
Instances
133
RTX4090
Cheapest
$0.131/hr
Median
$0.718/hr
Average
$1.01/hr
Providers
3
Instances
96

Cost Efficiency

Metric
H200
RTX4090
$/TFLOP/hr
$0.0060
$0.0044
$/GB-VRAM/hr
$0.0849
$0.0299

Lower $/TFLOP and $/GB-VRAM is better. Based on median hourly pricing.

Provider Availability

Both available on (2)

Only on RTX4090 (1)

H200 Cloud Pricing

133 instances
ProviderGPUsVRAMRegionTypePrice/hr
CHEAPESTVerda1x141 GBEU-CentralSpot$1.19Rent
Nebius1x141 GBeu-north1Spot$1.45Rent
Nebius1x141 GBEU-WestSpot$1.45Rent
Nebius1x141 GBUS-CentralSpot$1.45Rent
RunPod1x141 GBUS-EastSpot$2.29Rent
RunPod1x141 GBEU-FR-1Spot$2.29Rent
RunPod1x141 GBEUR-IS-2Spot$2.29Rent
RunPod1x141 GBEUR-IS-4Spot$2.29Rent
RunPod1x141 GBUS-CA-2Spot$2.29Rent
RunPod1x141 GBUS-GA-2Spot$2.29Rent

RTX4090 Cloud Pricing

96 instances
ProviderGPUsVRAMRegionTypePrice/hr
CHEAPESTVast.ai1x24 GBSpot$0.131Rent
RunPod1x24 GBCASpot$0.200Rent
RunPod1x24 GBFRSpot$0.200Rent
RunPod1x24 GBSESpot$0.200Rent
RunPod1x24 GBSKSpot$0.200Rent
RunPod1x24 GBTTSpot$0.200Rent
RunPod1x24 GBUSSpot$0.200Rent
RunPod1x24 GBEU-RO-1Spot$0.290Rent
RunPod1x24 GBEUR-IS-2Spot$0.290Rent
RunPod1x24 GBUS-CA-2Spot$0.290Rent

Compare with Other GPUs

RTX4090 vs ...