Dolphin Mistral 24B Venice Edition.
Dolphin Mistral 24B Venice Edition is an open Apache 2.0 uncensored fine-tune of Mistral Small 24B, made with Venice.ai and steered entirely by the system prompt.
1× Nvidia GeForce RTX 3090 · $0.15/hr.
Most-aggressive quantisation we have a working recommendation for. Lower precision = less VRAM = cheaper hardware, at a small accuracy cost.
Cheapest hosted endpoints.
| Provider | Access | $/M in | $/M out | |
|---|---|---|---|---|
| OpenRouter | api aggregator | $0.2 | $0.9 | Launch ↗ |
Cheapest hardware per quantisation.
Each row is one quantisation tier (the same weights compressed differently). Lower precision → lower VRAM → cheaper hardware, at the cost of small accuracy loss. $/hr refreshed hourly from each provider's API.
| Quantisation | Cheapest GPU config | Total VRAM | Live $/hr | tokens/sec | |
|---|---|---|---|---|---|
|
FP16
FP16 — half precision (default)
|
192 GB | $0.50/hr | 77.3 | Compare → | |
|
FP8
FP8 — 8-bit float (Hopper / Blackwell)
|
48 GB | $0.27/hr | 19.6 | Compare → | |
|
INT4
INT4 — 4-bit integer (~4× VRAM saving)
|
24 GB | $0.15/hr | 54.6 | Compare → |
What it costs per month across providers.
Estimate your monthly bill for Dolphin Mistral 24B Venice Edition across every host that publishes per-token pricing. Slide your token volumes; the chart + table re-rank cheapest-first.
Cheapest provider on the left.
Total monthly cost — input + output tokens combined.
Bill breakdown.
| Provider | Monthly total | |
|---|---|---|
| $3.8 | Sign up ↗ |
Rent the GPU instead of paying per token.
For an open-weights model like Dolphin Mistral 24B Venice Edition, you can rent a GPU and serve inference yourself. The math: cheapest GPU rental × 730 hours/month + your electricity rate × power draw.
Assumes the GPU runs 24/7 at ~85% utilisation. If your traffic is bursty, you'll pay less for the API and probably more for the GPU (idle hours still cost rental). The breakeven analysis lives on the Self-host vs API breakeven tool.
About Dolphin Mistral 24B Venice Edition.
Dolphin Mistral 24B Venice Edition is a fine-tune of Mistral Small 24B Instruct, made by the Dolphin team together with Venice.ai to be the most uncensored version of that model for the Venice ecosystem, where it runs as Venice Uncensored. Weights are open under Apache 2.0. Dolphin aims it as a general-purpose, steerable model: the system prompt sets its tone, alignment and rules, and it does not impose its own guidelines. It keeps Mistral's default chat template, and the maker recommends a low temperature of about 0.15.