Llama 4 Scout (17Bx16E).
2× Nvidia Q RTX 8000 · $0.54/hr.
Most-aggressive quantisation we have a working recommendation for. Lower precision = less VRAM = cheaper hardware, at a small accuracy cost.
Cheapest hosted endpoints.
| Provider | Access | $/M in | $/M out | |
|---|---|---|---|---|
| Together AI | hosted inference | — | — | Launch ↗ |
Variants in the Llama family.
Meta's best-in-class open-weight LLM — 70B class.
Llama 3.1 70B — production workhorse, superseded by 3.3 but still widely depl...
Meta's most popular open-weight small LLM — fits anywhere.
Meta's largest open-weight LLM — dense 405B, frontier-class at launch.
Meta's largest vision-capable Llama.
Meta's open-weight multimodal LLM — vision + text in 11B.
3B Llama — laptop-class chat + RAG.
Meta's smallest Llama — mobile + on-device target.
Meta's latest class of model (Llama 3) launched with a variety of sizes & fla...
Llama 3 8B Instruct is Meta's gated, English-focused chat model with 8B param...
Llama 4 Maverick 17B Instruct (128E) is a high-capacity multimodal language m...
An instruction-tuned open-weights mixture-of-experts model from Meta, 17B act...
Frequently asked.
How do I run Llama 4 Scout (17Bx16E)?
Where can I access Llama 4 Scout (17Bx16E)?
How much does it cost to run Llama 4 Scout (17Bx16E)?
Is Llama 4 Scout (17Bx16E) open-source or proprietary?
Cheapest hardware per quantisation.
Each row is one quantisation tier (the same weights compressed differently). Lower precision → lower VRAM → cheaper hardware, at the cost of small accuracy loss. $/hr is the cheapest rate on offer now. A multi-card setup uses a real instance of that size when one is rented; otherwise it is the single-card rate times the count.
| Quantisation | Cheapest GPU config | Total VRAM | Live $/hr | tokens/sec | |
|---|---|---|---|---|---|
|
FP16
FP16 — half precision (default)
|
384 GB |
$2.16/hr
est. 8 × single-card rate
Vast.ai · on-demand
|
— | Compare → | |
|
FP8
FP8 — 8-bit float (Hopper / Blackwell)
|
192 GB |
$1.08/hr
est. 4 × single-card rate
Vast.ai · on-demand
|
— | Compare → | |
|
INT4
INT4 — 4-bit integer (~4× VRAM saving)
|
96 GB |
$0.54/hr
est. 2 × single-card rate
Vast.ai · on-demand
|
— | Compare → |
What it costs per month across providers.
Estimate your monthly bill for Llama 4 Scout (17Bx16E) across every host that publishes per-token pricing. Slide your token volumes; the chart + table re-rank cheapest-first.
No priced API access rows on file for Llama 4 Scout (17Bx16E) yet.
Rent the GPU instead of paying per token.
For an open-weights model like Llama 4 Scout (17Bx16E), you can rent a GPU and serve inference yourself. The math: cheapest GPU rental × 730 hours/month. Power is included in a rental's hourly price.
Assumes the GPU runs 24/7 at ~85% utilisation. If your traffic is bursty, you'll pay less for the API and probably more for the GPU (idle hours still cost rental). The breakeven analysis lives on the Self-host vs API breakeven tool.