by Nvidia

Nemotron 3 Super.

text open weights datacenter 120B params 1M ctx
Cheapest input
$0.075/M
on DeepInfra
Cheapest output
$0.4/M
on DeepInfra
Smallest GPU
2× Nvidia Q RTX 8000
$0.51/hr
Run it yourself

Cheapest hardware per quantisation.

Each row is one quantisation tier (the same weights compressed differently). Lower precision → lower VRAM → cheaper hardware, at the cost of small accuracy loss. $/hr is the cheapest rate on offer now. A multi-card setup uses a real instance of that size when one is rented; otherwise it is the single-card rate times the count.

Quantisation Cheapest GPU config Total VRAM Live $/hr tokens/sec
FP16
FP16 — half precision (default)
384 GB $2.04/hr
est. 8 × single-card rate
Vast.ai · on-demand
— Compare →
FP8
FP8 — 8-bit float (Hopper / Blackwell)
192 GB $1.02/hr
est. 4 × single-card rate
Vast.ai · on-demand
— Compare →
INT4
INT4 — 4-bit integer (~4× VRAM saving)
96 GB $0.51/hr
est. 2 × single-card rate
Vast.ai · on-demand
— Compare →
Just need an API?
Skip the GPU rental and call a hosted endpoint instead. See access providers on the Overview tab →