LFM2-24B-A2B.
LFM2-24B-A2B is the largest model in the LFM2 family of hybrid architectures designed for efficient on-device deployment. Built as a 24B parameter Mixture-of-Experts model with only 2B active parameters per...
1× Nvidia RTX PRO 2000 Blackwell · $0.084/hr.
Most-aggressive quantisation we have a working recommendation for. Lower precision = less VRAM = cheaper hardware, at a small accuracy cost.
Variants in the LFM family.
Cheapest hardware per quantisation.
Each row is one quantisation tier (the same weights compressed differently). Lower precision → lower VRAM → cheaper hardware, at the cost of small accuracy loss. $/hr is the cheapest rate on offer now. A multi-card setup uses a real instance of that size when one is rented; otherwise it is the single-card rate times the count.
| Quantisation | Cheapest GPU config | Total VRAM | Live $/hr | tokens/sec | |
|---|---|---|---|---|---|
|
FP16
FP16 — half precision (default)
|
96 GB |
$0.54/hr
est. 2 × single-card rate
Vast.ai · on-demand
|
— | Compare → | |
|
FP8
FP8 — 8-bit float (Hopper / Blackwell)
|
48 GB |
$0.27/hr
Vast.ai · on-demand
|
19.6 | Compare → | |
|
INT4
INT4 — 4-bit integer (~4× VRAM saving)
|
16 GB |
$0.084/hr
Clore.ai · on-demand
|
16.8 | Compare → |
What it costs per month across providers.
Estimate your monthly bill for LFM2-24B-A2B across every host that publishes per-token pricing. Slide your token volumes; the chart + table re-rank cheapest-first.
No priced API access rows on file for LFM2-24B-A2B yet.
Rent the GPU instead of paying per token.
For an open-weights model like LFM2-24B-A2B, you can rent a GPU and serve inference yourself. The math: cheapest GPU rental × 730 hours/month. Power is included in a rental's hourly price.
Assumes the GPU runs 24/7 at ~85% utilisation. If your traffic is bursty, you'll pay less for the API and probably more for the GPU (idle hours still cost rental). The breakeven analysis lives on the Self-host vs API breakeven tool.