by Zhipu AI

Z.ai: GLM 4 32B .

text open weights workstation 32B params 128K ctx
Cheapest input
$0.1/M
on Zhipu BigModel
Cheapest output
$0.1/M
on Zhipu BigModel
Fastest
36 tok/s
on OpenRouter
Smallest GPU
1× Nvidia RTX 4000 Ada SFF
$0.17/hr
Run it yourself

Cheapest hardware per quantisation.

Each row is one quantisation tier (the same weights compressed differently). Lower precision → lower VRAM → cheaper hardware, at the cost of small accuracy loss. $/hr refreshed hourly from each provider's API.

Quantisation Cheapest GPU config Total VRAM Live $/hr tokens/sec
FP16
FP16 — half precision (default)
80 GB $0.48/hr Compare →
FP8
FP8 — 8-bit float (Hopper / Blackwell)
40 GB Compare →
INT4
INT4 — 4-bit integer (~4× VRAM saving)
20 GB $0.17/hr Compare →
Just need an API?
Skip the GPU rental and call a hosted endpoint instead. See access providers on the Overview tab →