Louer Nvidia Q RTX 6000.

Name: Nvidia Q RTX 6000
Brand: Nvidia
SKU: nvidia-q-rtx-6000

Turing 24GB de VRAM 295W From $0.26/hr

Per hour

$0.26

Per day

$6.13

Per week

$42.94

Per month

$184

Price history

Daily median across providers.

Where to rent it

All providers carrying this GPU.

Provider	$/hr	Range	Offers	30d trend	Updated
Vast.ai	$0.26/hr	$0.14/hr–$0.38/hr	2	↑ 3%	about 7 hours	Launch ↗

Buy vs rent

Should you rent or own?

Your usage

Hours per day Electricity rate ($/kWh)

Rent on cloud

Per day

—

Per month

—

at $0.26/hr cheapest provider rate

Own on-prem

Electricity per day

—

295W TDP

AI models that fit See all 229 →

Run these on this GPU.

Thinking Machines: Inkling Small 8× · int4
DeepSeek Coder V2 236B 8× · int4
Qwen: Qwen3 235B A22B Instruct 2507 8× · int4

AI models

Models that run on this GPU.

Modèles à poids ouverts qui tiennent sur cette carte pour l'inférence, avec le plus petit nombre de cartes et la précision qui chargent chacun. Calculé chaque jour à partir de la taille du modèle et de la mémoire de la carte. Les 60 plus grands des 229 modèles qui tiennent.

Renting for inference?

Pair these models with the cheapest provider on the rental table. See rental rates on the Overview tab →

FAQ

AI models on this GPU.

What AI models can I run on a Nvidia Q RTX 6000?

The list above shows open-weights models whose memory need fits this card: on one card when the model uses at least a quarter of its 24 GB, or on 2, 4 or 8 of them when it is too large for one. Each row gives the fewest cards and the precision (FP16, FP8 or INT4) that load it.

What's the VRAM minimum to run a model on the Nvidia Q RTX 6000?

We count the weights (parameters × bytes per weight: FP16 = 2, FP8 = 1, INT4 = 0.5), add the KV cache for an 8K-token context, and add 15% for the runtime. A model fits when that is within 90% of the cards' memory. A 70B model needs about 164 GB at FP16 and about 43 GB at INT4. A longer context needs more.

How does quantization (FP16 vs FP8 vs INT4) affect what fits?

Lower-precision quantization shrinks the memory footprint nearly linearly with the bit count. The trade-off is output quality: FP16 is the reference, FP8 is usually indistinguishable for most prompts, INT8 introduces small quality losses, INT4 is noticeably degraded on reasoning-heavy tasks but fine for chat. The badge on each row tells you which level the recommendation assumes.

Can I fine-tune on the Nvidia Q RTX 6000 or only do inference?

The rows here are for inference. Full fine-tuning needs several times more memory than inference at the same model size, because gradients, optimizer state and activations all live in memory. LoRA and QLoRA cut that a lot. The fine-tune cost tool sizes a run for you.

How are these GPU counts worked out?

We compute them every day from the model's parameter count and the card's memory, with the formula above. They are estimates, not tests we ran. Tokens per second, where shown, is an estimate from the card's memory bandwidth on one card.

Louer Nvidia Q RTX 6000.

Daily median across providers.

All providers carrying this GPU.

Should you rent or own?

Run these on this GPU.

Models that run on this GPU.

Thinking Machines: Inkling Small

DeepSeek Coder V2 236B

Qwen: Qwen3 235B A22B Instruct 2507

Qwen 3 235B

Qwen: Qwen3 VL 235B A22B Thinking

Qwen: Qwen3 Max

Qwen: Qwen3 235B A22B Thinking 2507

Qwen: Qwen3 VL 235B A22B Instruct

MiniMax: MiniMax M2.5

MiniMax: MiniMax M2.7

MiniMax: MiniMax M2.1

MiniMax: MiniMax M2

MiniMax: MiniMax M3.1 Flash

StepFun: Step 3.7 Flash

Seed-1.8

StepFun: Step 3.5 Flash

Mixtral 8x22B

Mistral: Devstral 2 2512

Ling-3.0-flash

Ling 3.0 Flash Fin

Ling-3.0-flash-VL

Mistral Large 2

Qwen: Qwen3.5-122B-A10B

Mistral: Mistral Small 4

NVIDIA: Nemotron 3 Super

GPT-OSS 120B

Poolside: Laguna S 2.1

Llama 4 Scout (17Bx16E)

Meta: Llama 4 Scout

Z.ai: GLM 4.5V

Z.ai: GLM 4.6V

inclusionAI: Ling-2.6-flash

Prime Intellect: INTELLECT-3

GLM-4.5-Air

Command R+

Llama 3.2 90B Vision

Qwen: Qwen3 Next 80B A3B Thinking

Qwen: Qwen3 Next 80B A3B Instruct

Tencent: Hunyuan A13B Instruct

Qwen: Qwen3 Coder Next

Arcee AI: Virtuoso Large

Qwen 2.5 72B

Qwen2 72B Instruct

Qwen 2 (72B)

Qwen: Qwen2.5 VL 72B Instruct

Magnum v4 72B

Qwen2.5 72B

Qwen2-VL (72B) Instruct

Cogito V1 Preview Llama 70B

Sao10K: Llama 3.1 70B Hanami x1

Nous: Hermes 4 70B

Sao10K: Llama 3.3 Euryale 70B

Llama 3.1 Nemotron 70B Instruct HF

Sao10k: Llama 3 Euryale 70B v2.1

Meta: Llama 3 70B Instruct

Code Llama 70B

Llama 3.3 70B

DeepSeek R1 Distill Llama 70B

Llama 3.1 70B

Hermes 3 70B

AI models on this GPU.