Cheap inference.

Mid-range GPUs that run quantized 7B–13B models at the lowest hourly rates.

GPU	Tier	Architecture	VRAM	Providers	AI models	From
Nvidia GeForce RTX 3060	consumer	Ampere	12GB	4 →	—	$0.038/hr	Compare →
Nvidia RTX A4000	workstation	Ampere	16GB	8 →	—	$0.048/hr	Compare →
Nvidia RTX 4070 Ti SUPER	consumer	Ada Lovelace	16GB	3 →	—	$0.068/hr	Compare →
Nvidia GeForce RTX 4070	consumer	Ada Lovelace	12GB	3 →	—	$0.076/hr	Compare →
Nvidia GeForce RTX 3090	consumer	Ampere	24GB	8 →	—	$0.082/hr	Compare →
Nvidia RTX 3060 Laptop GPU	consumer	Ampere	12GB	2 →	—	$0.091/hr	Compare →
Nvidia RTX 5070	consumer	Blackwell	12GB	3 →	—	$0.12/hr	Compare →
Nvidia RTX 5070 Ti	consumer	Blackwell	16GB	2 →	—	$0.12/hr	Compare →
Nvidia RTX A2000 12GB	workstation	Ampere	12GB	1 →	—	$0.12/hr	Compare →
Nvidia GeForce RTX 4080	consumer	Ada Lovelace	16GB	4 →	—	$0.13/hr	Compare →
Nvidia GeForce RTX 5080	consumer	Blackwell	16GB	5 →	—	$0.13/hr	Compare →
Nvidia RTX 4070 SUPER	consumer	Ada Lovelace	12GB	2 →	—	$0.16/hr	Compare →
Nvidia RTX A5000	workstation	Ampere	24GB	6 →	—	$0.16/hr	Compare →
Nvidia GeForce RTX 3080Ti	consumer	Ampere	12GB	3 →	—	$0.17/hr	Compare →
Nvidia RTX 5060 Ti	consumer	Blackwell	16GB	2 →	—	$0.17/hr	Compare →
Nvidia RTX 4000 Ada SFF	workstation	Ada Lovelace	20GB	1 →	—	$0.18/hr	Compare →
Nvidia RTX A4500	workstation	Ampere	20GB	1 →	—	$0.19/hr	Compare →
Nvidia RTX 4070 Ti	consumer	Ada Lovelace	12GB	2 →	—	$0.19/hr	Compare →
Nvidia RTX 4000 Ada	workstation	Ada Lovelace	20GB	4 →	—	$0.20/hr	Compare →
Nvidia GeForce RTX 3090 Ti	consumer	Ampere	24GB	2 →	—	$0.21/hr	Compare →
Nvidia GeForce RTX 5090	consumer	Blackwell	32GB	10 →	—	$0.21/hr	Compare →
Nvidia RTX 4090 D	consumer	Ada Lovelace	24GB	2 →	—	$0.26/hr	Compare →
Nvidia GeForce RTX 4080 Super	consumer	Ada Lovelace	16GB	3 →	—	$0.28/hr	Compare →
Nvidia RTX PRO 4500 Blackwell	workstation	Blackwell	32GB	5 →	—	$0.29/hr	Compare →
Nvidia GeForce RTX 4090	consumer	Ada Lovelace	24GB	10 →	—	$0.30/hr	Compare →
Nvidia RTX A6000	workstation	Ampere	48GB	10 →	—	$0.32/hr	Compare →
Nvidia RTX PRO 4000 Blackwell	workstation	Blackwell	24GB	2 →	—	$0.38/hr	Compare →
Nvidia RTX 5090 D	consumer	Blackwell	32GB	1 →	—	$0.41/hr	Compare →
Nvidia RTX 5000 Ada	workstation	Ada Lovelace	32GB	1 →	—	$0.49/hr	Compare →
Nvidia RTX 2000 Ada	workstation	Ada Lovelace	16GB	1 →	—	$0.50/hr	Compare →
Nvidia RTX 6000 Ada	workstation	Ada Lovelace	48GB	7 →	—	$0.54/hr	Compare →
Nvidia RTX PRO 5000 Blackwell	workstation	Blackwell	48GB	3 →	—	$0.63/hr	Compare →
Nvidia RTX PRO 6000 Blackwell Max-Q Workstation	workstation	Blackwell	96GB	1 →	—	$0.86/hr	Compare →
Nvidia RTX PRO 6000 WS	workstation	Blackwell	96GB	2 →	—	$0.91/hr	Compare →
Nvidia RTX PRO 6000 MaxQ	workstation	Blackwell	96GB	2 →	—	$0.93/hr	Compare →
Nvidia RTX PRO 6000 S	workstation	Blackwell	96GB	3 →	—	$0.99/hr	Compare →
Nvidia RTX PRO 6000 Blackwell Workstation	workstation	Blackwell	96GB	3 →	—	$1.15/hr	Compare →
Nvidia RTX PRO 6000 WK	workstation	Blackwell	96GB	1 →	—	$1.69/hr	Compare →
Nvidia RTX PRO 6000 Blackwell	workstation	Blackwell	96GB	8 →	—	$1.69/hr	Compare →