by Thedrummer

TheDrummer: Rocinante 12B.

text open weights laptop+ 12B params 33K ctx
Cheapest input
$0.17/M
on OpenRouter
Cheapest output
$0.43/M
on OpenRouter
Fastest
47 tok/s
on OpenRouter
Smallest GPU
1× AMD Radeon RX 5700 XT

Rocinante 12B is designed for engaging storytelling and rich prose. Early testers have reported: - Expanded vocabulary with unique and expressive word choices - Enhanced creativity for vivid narratives -...

Smallest GPU to run it See all quantisations →

1× AMD Radeon RX 5700 XT.

Most-aggressive quantisation we have a working recommendation for. Lower precision = less VRAM = cheaper hardware, at a small accuracy cost.

Where to use it

Cheapest hosted endpoints.

Provider Access $/M in $/M out
OpenRouter api aggregator $0.17 $0.43 Launch ↗
Performance

Speed across providers.

Tokens/sec and time-to-first-token measured against the same prompt template on each provider's API.

Provider Tokens/sec TTFT Total
OpenRouter 47.0 1176 ms 2042 ms
FAQ

Frequently asked.

How do I run TheDrummer: Rocinante 12B?
TheDrummer: Rocinante 12B is open-weight, so you can self-host on rented GPUs. See the Run It Yourself tab for GPU configurations + cost estimates, or use one of the hosted inference providers listed on this page.
Where can I access TheDrummer: Rocinante 12B?
TheDrummer: Rocinante 12B is available via OpenRouter. Each access option lists its own pricing (per million tokens or hourly hosting).
How much does it cost to run TheDrummer: Rocinante 12B?
API pricing starts at $0.17/M input tokens and $0.43/M output tokens. Self-hosting cost depends on the GPU you rent — see the Run It Yourself tab.
Is TheDrummer: Rocinante 12B open-source or proprietary?
TheDrummer: Rocinante 12B is open-weight under the license. You can download and self-host it.