How much does an H100 cloud GPU cost per hour?

The cheapest H100 cloud GPU currently tracked by GPU Tracker is Verda H100 at $0.801/hr. Prices vary by provider, region, and spot versus on-demand availability.

How much does an A100 cloud GPU cost per hour?

The cheapest A100 cloud GPU currently tracked by GPU Tracker is Vast.ai A100 at $0.0800/hr. Use the live table to compare spot and on-demand listings.

Where can I rent an RTX 5090 cloud GPU?

GPU Tracker currently tracks RTX 5090 cloud GPU listings, with the cheapest listing from Vast.ai at $0.0940/hr in the current dataset.

Which GPU is best for LLM inference?

For 7B to 13B models, RTX 4090 and L40S are strong value picks. For 70B models, start with 80GB or more total VRAM such as A100 80GB, H100, or H200, depending on latency and context length.

Cloud GPU Prices

The cheapest price for every GPU, across every major cloud provider. Live data, no sign-up.

5,213 instances·54 providers·Live

Fast answers from live GPU pricing data

Compare H100, A100, H200, RTX 4090, RTX 5090, VRAM tiers, and provider prices from the current GPU Tracker dataset.

Cheapest GPU right now RTX 5090 cloud price Best GPU for 70B LLMs Price per GB VRAM GPU VRAM tracker LLM cost calculator

View://

Token cost model

vs GPT-4o API $2.50/1M

GPU	Provider	VRAM	Score	Risk	$/1M Tok	Price/Hr	Actions
RTX5070Spot Blackwell · 35162384	Vast.ai	12GB	100	High Risk	$0.00	$0.0067	Deploy
V100Spot Older · 35091477	Vast.ai	16GB	52	High Risk	$0.00	$0.0133	Deploy
V100Spot Older · 33625622	Vast.ai	16GB	47	High Risk	$0.00	$0.0147	Deploy
RTX3090Spot Ampere · 31434575	Vast.ai	24GB	31	High Risk	$0.00	$0.0210	Deploy
V100×2Spot Older · 35091474	Vast.ai	32GB	31	High Risk	$0.00	$0.0267	Deploy
V100×2Spot Older · 33681219	Vast.ai	32GB	29	High Risk	$0.00	$0.0293	Deploy
V100 Older · 33625622	Vast.ai	16GB	20	Variable	$0.01	$0.0344	Deploy
V100 Older · 35091477	Vast.ai	16GB	20	Variable	$0.01	$0.0351	Deploy
RTX5070Spot Blackwell · 29807823	Vast.ai	12GB	17	High Risk	$0.00	$0.0400	Deploy
V100Spot Older · 1V100.6V	Verda	16GB	14	High Risk	$0.01	$0.0483	Deploy
V100×4Spot Older · 33741048	Vast.ai	64GB	21	High Risk	$0.00	$0.0533	Deploy
RTX3090Spot Ampere · 32353633	Vast.ai	24GB	12	High Risk	$0.01	$0.0533	Deploy
RTX5060TiSpot Blackwell · 33250363	Vast.ai	16GB	7	High Risk	$0.00	$0.0533	Deploy
A16 Older · vcg-a16-2c-8g-2vram	Vultr	2GB	3	Stable	—	$0.0590	Deploy
A16 Older · vcg-a16-2c-8g-2vram	Vultr	2GB	3	Stable	—	$0.0590	Deploy
A16 Older · vcg-a16-2c-8g-2vram	Vultr	2GB	3	Stable	—	$0.0590	Deploy
A16 Older · vcg-a16-2c-8g-2vram	Vultr	2GB	3	Stable	—	$0.0590	Deploy
A16 Older · vcg-a16-2c-8g-2vram	Vultr	2GB	3	Stable	—	$0.0590	Deploy
A16 Older · vcg-a16-2c-8g-2vram	Vultr	2GB	3	Stable	—	$0.0590	Deploy
A16 Older · vcg-a16-2c-8g-2vram	Vultr	2GB	3	Stable	—	$0.0590	Deploy
A16 Older · vcg-a16-2c-8g-2vram	Vultr	2GB	3	Stable	—	$0.0590	Deploy
A16 Older · vcg-a16-2c-8g-2vram	Vultr	2GB	3	Stable	—	$0.0590	Deploy
RTX4070STiSpot Ada Lovelace · 30247109	Vast.ai	16GB	6	High Risk	$0.01	$0.0667	Deploy
T4Spot Older · Standard_NC4as_T4_v3	Azure	16GB	4	Variable	$0.02	$0.0684	Deploy
T4Spot Older · Standard_NC4as_T4_v3	Azure	16GB	4	Variable	$0.02	$0.0686	Deploy
V100×2 Older · 35091474	Vast.ai	32GB	12	Variable	$0.01	$0.0702	Deploy
V100×2 Older · 33681219	Vast.ai	32GB	12	Variable	$0.01	$0.0722	Deploy
A40 Ada Lovelace · vcg-a40-1c-5g-2vram	Vultr	2GB	8	Stable	$0.01	$0.0750	Deploy
A40 Ada Lovelace · vcg-a40-1c-5g-2vram	Vultr	2GB	8	Stable	$0.01	$0.0750	Deploy
A40 Ada Lovelace · vcg-a40-1c-5g-2vram	Vultr	2GB	8	Stable	$0.01	$0.0750	Deploy
A40 Ada Lovelace · vcg-a40-1c-5g-2vram	Vultr	2GB	8	Stable	$0.01	$0.0750	Deploy
A40 Ada Lovelace · vcg-a40-1c-5g-2vram	Vultr	2GB	8	Stable	$0.01	$0.0750	Deploy
A40 Ada Lovelace · vcg-a40-1c-5g-2vram	Vultr	2GB	8	Stable	$0.01	$0.0750	Deploy
RTX5070Spot Blackwell · 35163499	Vast.ai	12GB	9	High Risk	$0.00	$0.0773	Deploy
A100Spot Ampere · 31500045	Vast.ai	40GB	20	High Risk	$0.00	$0.0800	Deploy
A10Spot Ampere · Standard_NV6ads_A10_v5	Azure	4GB	6	Variable	$0.01	$0.0839	Deploy
A10Spot Ampere · Standard_NV6ads_A10_v5	Azure	4GB	6	Variable	$0.01	$0.0839	Deploy
RTX3090Spot Ampere · 31592771	Vast.ai	24GB	7	High Risk	$0.01	$0.0893	Deploy
RTX3080TiSpot Ampere · NVIDIA GeForce RTX 3080 Ti	RunPod	12GB	6	Variable	$0.01	$0.0900	Deploy
A10Spot Ampere · Standard_NV6ads_A10_v5	Azure	4GB	5	Variable	$0.01	$0.0926	Deploy
A100 Ampere · 31500045	Vast.ai	40GB	17	Variable	$0.00	$0.0934	Deploy
RTX5090Spot Blackwell · 29784082	Vast.ai	32GB	14	High Risk	$0.00	$0.0940	Deploy
RTX4070STiSpot Ada Lovelace · 34158117	Vast.ai	16GB	4	High Risk	$0.01	$0.0960	Deploy
V100×2Spot Older · 2V100.10V	Verda	32GB	9	High Risk	$0.01	$0.0966	Deploy
T4Spot Older · Standard_NC8as_T4_v3	Azure	16GB	3	Variable	$0.02	$0.0977	Deploy
T4Spot Older · Standard_NC8as_T4_v3	Azure	16GB	3	Variable	$0.02	$0.0980	Deploy
A10Spot Ampere · Standard_NV6ads_A10_v5	Azure	4GB	5	Variable	$0.01	$0.0981	Deploy
A4500Spot Older · NVIDIA RTX A4500	RunPod	20GB	4	Variable	—	$0.100	Deploy
RTX4070TiSpot Ada Lovelace · NVIDIA GeForce RTX 4070 Ti	RunPod	12GB	5	Variable	$0.01	$0.100	Deploy
RTX3090Spot Ampere · 20351264	Vast.ai	24GB	7	High Risk	$0.01	$0.100	Deploy

Showing 1–50 of 5,213