Will my model fit on this GPU?

Compute the VRAM you need for a given AI model at a chosen precision and context window, and see exactly which rentable GPUs have the headroom — plus the cheapest provider for each.

GPUs that fit

Sorted by VRAM ascending — smallest fitting card first (usually the cheapest).

GPU	VRAM	FP16 TFLOPS	TDP	Cheapest provider	$/hr
Nvidia H100 NVL	80GB	—	—	Nosana	$1.19/hr	Open →
Nvidia H100	80GB	—	—	Thunder Compute	$3.20/hr	Open →
Nvidia A800 PCIe	80GB	—	300W	Vast.ai	$0.74/hr	Open →
Nvidia H100 PCIe	80GB	—	—	io.net	$1.00/hr	Open →
Nvidia A100 80GB PCIe	80GB	—	—	Thunder Compute	$1.09/hr	Open →
Nvidia H100 SXM	80GB	—	—	Lium	$2.00/hr	Open →
Nvidia GH200	96GB	—	1000W	no live offers	—	Open →
Intel Gaudi2	96GB	—	600W	Cyfuture AI	$1.06/hr	Open →
Nvidia RTX PRO 6000 Blackwell Workstation	96GB	—	—	no live offers	—	Open →
Nvidia RTX PRO 6000 WS	96GB	—	—	Nosana	$0.91/hr	Open →
Nvidia RTX PRO 6000 Blackwell	96GB	—	600W	Hyperstack	$1.85/hr	Open →
Nvidia RTX PRO 6000 WK	96GB	—	—	RunPod	$1.69/hr	Open →
Nvidia RTX PRO 6000	96GB	—	—	RunPod	$1.69/hr	Open →
Nvidia RTX PRO 6000 Blackwell Max-Q Workstation	96GB	—	—	Clore.ai	$0.88/hr	Open →
Nvidia RTX PRO 6000 S	96GB	—	—	Vast.ai	$1.47/hr	Open →
Nvidia RTX PRO 6000 Blackwell Server Edition	96GB	—	—	no live offers	—	Open →
Nvidia RTX PRO 6000 MaxQ	96GB	—	—	Vast.ai	$1.31/hr	Open →
Nvidia H200 SXM	141GB	—	—	RunPod	$3.59/hr	Open →
Nvidia H200	141GB	—	—	Vast.ai	$3.95/hr	Open →
Nvidia H200 NVL	141GB	—	—	RunPod	$0.50/hr	Open →
AMD MI300	192GB	—	750W	no live offers	—	Open →
Nvidia B200	192GB	—	—	DeepInfra	$3.69/hr	Open →
AMD MI300X	192GB	—	—	RunPod	$0.50/hr	Open →
AMD MI325	256GB	—	1000W	no live offers	—	Open →
Nvidia GB300	288GB	—	2700W	no live offers	—	Open →
Nvidia B300 SXM6 AC	288GB	—	—	Lium	$8.00/hr	Open →
Nvidia B300	288GB	—	—	io.net	$6.73/hr	Open →
AMD MI355X	288GB	—	1400W	no live offers	—	Open →