GPU group

LLM fine-tuning.

GPUs with 80GB+ VRAM — comfortable for LoRA / QLoRA on 70B-class models.

GPU	Tier	Architecture	VRAM	Providers	AI models	From
AMD MI300X	datacenter	CDNA 3	192GB	5 →	—	$0.50/hr	Compare →
Nvidia H200 NVL	datacenter	Hopper	141GB	3 →	—	$0.50/hr	Compare →
Nvidia A100 80GB PCIe	datacenter	Ampere	80GB	10 →	—	$0.65/hr	Compare →
Nvidia RTX PRO 6000 Blackwell Max-Q Workstation	workstation	Blackwell	96GB	1 →	—	$0.86/hr	Compare →
Nvidia RTX PRO 6000 Blackwell Server Edition	datacenter	Blackwell	96GB	2 →	—	$0.91/hr	Compare →
Nvidia RTX PRO 6000 WS	workstation	Blackwell	96GB	2 →	—	$0.91/hr	Compare →
Nvidia RTX PRO 6000 MaxQ	workstation	Blackwell	96GB	2 →	—	$0.93/hr	Compare →
Nvidia RTX PRO 6000 S	workstation	Blackwell	96GB	3 →	—	$0.99/hr	Compare →
Nvidia H100 NVL	datacenter	Hopper	80GB	5 →	—	$0.99/hr	Compare →
Nvidia H100 PCIe	datacenter	Hopper	80GB	7 →	—	$1.00/hr	Compare →
Intel Gaudi2	datacenter	Xe-HPC	96GB	1 →	—	$1.01/hr	Compare →
Nvidia RTX PRO 6000 Blackwell Workstation	workstation	Blackwell	96GB	3 →	—	$1.15/hr	Compare →
Nvidia H100 SXM	datacenter	Hopper	80GB	12 →	—	$1.30/hr	Compare →
Nvidia RTX PRO 6000 WK	workstation	Blackwell	96GB	1 →	—	$1.69/hr	Compare →
Nvidia RTX PRO 6000 Blackwell	workstation	Blackwell	96GB	8 →	—	$1.69/hr	Compare →
Nvidia H100	datacenter	Hopper	80GB	3 →	—	$2.29/hr	Compare →
Nvidia H200	datacenter	Hopper	141GB	9 →	—	$2.63/hr	Compare →
AMD MI325	datacenter	CDNA 3	256GB	1 →	—	$2.98/hr	Compare →
Nvidia H200 SXM	datacenter	Hopper	141GB	2 →	—	$3.59/hr	Compare →
Nvidia B200	datacenter	Blackwell	192GB	7 →	—	$4.99/hr	Compare →
Nvidia B300	datacenter	Blackwell	288GB	6 →	—	$6.73/hr	Compare →
Nvidia B300 SXM6 AC	datacenter	Blackwell	288GB	1 →	—	$8.00/hr	Compare →
AMD MI355X	datacenter	CDNA 3	288GB	1 →	—	$8.60/hr	Compare →