Cheap inference.

Mid-range GPUs that run quantized 7B–13B models at the lowest hourly rates.

GPU	Tier	Architecture	VRAM	Providers	AI models	From
Nvidia RTX 3060	consumer	Ampere	12GB	1 →	—	$0.019/hr	Compare →
Nvidia RTX 4070	consumer	Ada Lovelace	12GB	1 →	—	$0.020/hr	Compare →
Nvidia RTX A2000	workstation	Ampere	12GB	2 →	—	$0.022/hr	Compare →
Nvidia RTX A4500	workstation	Ampere	20GB	2 →	—	$0.025/hr	Compare →
Nvidia RTX A4000	workstation	Ampere	16GB	4 →	—	$0.026/hr	Compare →
Nvidia RTX 4060 Ti	consumer	Ada Lovelace	16GB	1 →	—	$0.051/hr	Compare →
Nvidia RTX 4070 Ti	consumer	Ada Lovelace	12GB	2 →	—	$0.055/hr	Compare →
Nvidia RTX 4070 Ti Super	consumer	Ada Lovelace	16GB	1 →	—	$0.059/hr	Compare →
Nvidia RTX 5060 Ti	consumer	Blackwell	16GB	1 →	—	$0.062/hr	Compare →
Nvidia RTX 3090	consumer	Ampere	24GB	5 →	—	$0.063/hr	Compare →
Nvidia RTX 4070 Super	consumer	Ada Lovelace	12GB	1 →	—	$0.071/hr	Compare →
Nvidia RTX 3080Ti	consumer	Ampere	12GB	1 →	—	$0.080/hr	Compare →
Nvidia RTX 5070 Ti	consumer	Blackwell	16GB	2 →	—	$0.093/hr	Compare →
Nvidia RTX 4080	consumer	Ada Lovelace	16GB	3 →	—	$0.11/hr	Compare →
Nvidia RTX 4090	consumer	Ada Lovelace	24GB	10 →	—	$0.12/hr	Compare →
Nvidia RTX 3080 Ti	consumer	Ampere	12GB	2 →	—	$0.13/hr	Compare →
Nvidia RTX PRO 4500 Blackwell	workstation	Blackwell	32GB	2 →	—	$0.14/hr	Compare →
Nvidia RTX A5000	workstation	Ampere	24GB	3 →	—	$0.15/hr	Compare →
Nvidia RTX 5070	consumer	Blackwell	12GB	1 →	—	$0.16/hr	Compare →
Nvidia RTX 3090 Ti	consumer	Ampere	24GB	2 →	—	$0.17/hr	Compare →
Nvidia RTX 4000 Ada SFF	workstation	Ada Lovelace	20GB	1 →	—	$0.17/hr	Compare →
Nvidia RTX 5080	consumer	Blackwell	16GB	3 →	—	$0.17/hr	Compare →
Nvidia RTX 4000 Ada	workstation	Ada Lovelace	20GB	1 →	—	$0.19/hr	Compare →
Nvidia RTX 4090D	consumer	Ada Lovelace	24GB	1 →	—	$0.24/hr	Compare →
Nvidia RTX 5090	consumer	Blackwell	32GB	6 →	—	$0.29/hr	Compare →
Nvidia RTX A6000	workstation	Ampere	48GB	3 →	—	$0.31/hr	Compare →
Nvidia Nvidia RTX A4000	workstation	Ampere	16GB	1 →	—	$0.32/hr	Compare →
Nvidia RTX 5000 Ada	workstation	Ada Lovelace	32GB	2 →	—	$0.44/hr	Compare →
Nvidia RTX PRO 4000 Blackwell	workstation	Blackwell	24GB	1 →	—	$0.46/hr	Compare →
Nvidia RTX 2000 Ada	workstation	Ada Lovelace	16GB	1 →	—	$0.46/hr	Compare →
Nvidia RTX 6000 Ada	workstation	Ada Lovelace	48GB	5 →	—	$0.56/hr	Compare →
Nvidia RTX PRO 6000 Blackwell	workstation	Blackwell	96GB	1 →	—	$1.53/hr	Compare →