by Alibaba (Qwen Team)
Qwen 2.5 3B.
text
open weights
edge
3B params
33K ctx
🧬 Distilled from
Qwen 2.5 72B
— smaller, cheaper to run, similar reasoning style.
Smallest GPU
1× Nvidia Titan V
3B Qwen 2.5 — laptop / edge target.
Smallest GPU to run it
See all quantisations →
1× Nvidia Titan V.
Most-aggressive quantisation we have a working recommendation for. Lower precision = less VRAM = cheaper hardware, at a small accuracy cost.
Where to use it
Cheapest hosted endpoints.
Family
Qwen 2.5 72B
Qwen 2.5 7B
Qwen 2.5 14B
Qwen 2.5 32B
Qwen 2.5 Coder 32B
Variants in the Qwen family.
72.7B
open
Qwen License
Alibaba's flagship open-weight LLM — 72B dense.
7.6B
open
Qwen License
7B Qwen 2.5 — most popular Qwen variant on Ollama.
14.7B
open
Qwen License
14B Qwen 2.5 — sweet spot for single-GPU local hosting.
32.5B
open
Qwen License
32B Qwen 2.5 — laptop-class workhorse.
32.5B
open
Apache-2.0
Alibaba's open-weight coding model — best in class for 32B.
FAQ
Frequently asked.
How do I run Qwen 2.5 3B?
Qwen 2.5 3B is open-weight, so you can self-host on rented GPUs. See the Run It Yourself tab for GPU configurations + cost estimates, or use one of the hosted inference providers listed on this page.
Where can I access Qwen 2.5 3B?
Qwen 2.5 3B is available via Alibaba DashScope, Ollama. Each access option lists its own pricing (per million tokens or hourly hosting).
How much does it cost to run Qwen 2.5 3B?
Self-hosting cost depends on the GPU you rent and the throughput you need. See the Run It Yourself tab for GPU configurations and hourly cost estimates.
Is Qwen 2.5 3B open-source or proprietary?
Qwen 2.5 3B is open-weight under the Qwen License license. You can download and self-host it.
Run it yourself
Cheapest hardware per quantisation.
Each row is one quantisation tier (the same weights compressed differently). Lower precision → lower VRAM → cheaper hardware, at the cost of small accuracy loss. $/hr refreshed hourly from each provider's API.
| Quantisation | Cheapest GPU config | Total VRAM | Live $/hr | tokens/sec | |
|---|---|---|---|---|---|
|
FP16
FP16 — half precision (default)
|
8 GB | — | — | Compare → | |
|
FP8
FP8 — 8-bit float (Hopper / Blackwell)
|
4 GB | — | — | Compare → | |
|
INT4
INT4 — 4-bit integer (~4× VRAM saving)
|
3 GB | — | — | Compare → |
Just need an API?
Skip the GPU rental and call a hosted endpoint instead.
See access providers on the Overview tab →
Context window
How much it can remember.
33K tokens
≈ 24,576 English words
4K
32K
128K
1M
Capabilities
What it can do.
·
Vision input
·
Audio input
·
Video input
·
Function calling
·
Tool use
·
JSON mode
✓
Streaming
·
Fine-tuning