by Microsoft
Phi-3 Mini.
text
open weights
edge
4B params
128K ctx
🧬 Distilled from
Phi-4
— smaller, cheaper to run, similar reasoning style.
Smallest GPU
1× Nvidia Titan V
Smallest GPU to run it
See all quantisations →
1× Nvidia Titan V.
Most-aggressive quantisation we have a working recommendation for. Lower precision = less VRAM = cheaper hardware, at a small accuracy cost.
Family
Variants in the Phi family.
FAQ
Frequently asked.
How do I run Phi-3 Mini?
Phi-3 Mini is open-weight, so you can self-host on rented GPUs. See the Run It Yourself tab for GPU configurations + cost estimates, or use one of the hosted inference providers listed on this page.
Where can I access Phi-3 Mini?
Phi-3 Mini's access providers haven't been catalogued yet on RentGPU. Check the maker's documentation for official endpoints.
How much does it cost to run Phi-3 Mini?
Self-hosting cost depends on the GPU you rent and the throughput you need. See the Run It Yourself tab for GPU configurations and hourly cost estimates.
Is Phi-3 Mini open-source or proprietary?
Phi-3 Mini is open-weight under the MIT license. You can download and self-host it.
Run it yourself
Cheapest hardware per quantisation.
Each row is one quantisation tier (the same weights compressed differently). Lower precision → lower VRAM → cheaper hardware, at the cost of small accuracy loss. $/hr refreshed hourly from each provider's API.
| Quantisation | Cheapest GPU config | Total VRAM | Live $/hr | tokens/sec | |
|---|---|---|---|---|---|
|
FP16
FP16 — half precision (default)
|
10 GB | — | — | Compare → | |
|
FP8
FP8 — 8-bit float (Hopper / Blackwell)
|
5 GB | — | — | Compare → | |
|
INT4
INT4 — 4-bit integer (~4× VRAM saving)
|
3 GB | — | — | Compare → |
Just need an API?
Skip the GPU rental and call a hosted endpoint instead.
See access providers on the Overview tab →
Context window
How much it can remember.
128K tokens
≈ 96,000 English words
4K
32K
128K
1M
Capabilities
What it can do.
·
Vision input
·
Audio input
·
Video input
·
Function calling
·
Tool use
·
JSON mode
✓
Streaming
·
Fine-tuning