by DeepSeek

DeepSeek R1 Distill Qwen 7B.

text open weights edge 8B params 128K ctx Transformer (distilled)
🧬 Distilled from DeepSeek R1 — smaller, cheaper to run, similar reasoning style.
Smallest GPU
1× Nvidia GeForce GTX 1660 Super
$0.027/hr
Run it yourself

Cheapest hardware per quantisation.

Each row is one quantisation tier (the same weights compressed differently). Lower precision → lower VRAM → cheaper hardware, at the cost of small accuracy loss. $/hr refreshed hourly from each provider's API.

Quantisation Cheapest GPU config Total VRAM Live $/hr tokens/sec
FP16
FP16 — half precision (default)
24 GB $0.083/hr — Compare →
FP8
FP8 — 8-bit float (Hopper / Blackwell)
10 GB — — Compare →
INT8
INT8 — 8-bit integer
Slow but workable on 16GB T4.
16 GB $0.11/hr — Compare →
INT4
INT4 — 4-bit integer (~4× VRAM saving)
6 GB $0.027/hr — Compare →
Just need an API?
Skip the GPU rental and call a hosted endpoint instead. See access providers on the Overview tab →