workstation
Thuê Nvidia RTX A2000 12GB.
Ampere
12GB VRAM
70W
2021
From $0.084/hr
Per hour
$0.084
Per day
$2.03
Per week
$14.20
Per month
$61
Price history
Daily median across providers.
Loading...
Buy vs rent
Should you rent or own?
Your usage
Rent on cloud
Per day
—
Per month
—
at $0.084/hr cheapest provider rate
Own on-prem
Electricity per day
—
70W TDP
Cloud instance options
Pre-configured instances on hyperscalers.
Whole-instance bundles (GPU + vCPU + RAM + disk) on the major clouds. Per-GPU rate often drops as the count rises. View = spec page · Launch = sign up (affiliate).
Cheapest bundle
$0.08/hr
Lowest $/hr per GPU
$0.084/hr
Providers
1
Instance shapes
1
| Provider | Instance | GPUs | vCPU | RAM | Disk | $/hr | $/hr per GPU | |
|---|---|---|---|---|---|---|---|---|
| community-1x | 1× | — | — | — | $0.08/hr | $0.084/hr |
Looking for the cheapest rate?
Hyperscaler bundles include managed networking + SLAs. Raw per-GPU rental on P2P marketplaces is typically 3–10× cheaper.
See raw rental rates on the Overview tab →
AI models
INT4
INT4
INT4
INT4
INT4
INT4
INT4
INT4
INT4
INT4
INT4
INT4
INT4
INT4
INT4
INT4
INT4
INT4
INT4
INT4
FP8
FP8
FP8
FP8
FP8
FP8
FP8
FP8
FP8
FP8
FP8
FP8
FP8
FP8
FP8
FP8
FP8
FP8
FP8
FP8
FP8
FP8
FP8
FP8
FP8
FP8
FP8
FP8
FP8
FP8
Models that run on this GPU.
Các mô hình mở trọng số chạy được trên card này để suy luận, với số card ít nhất và độ chính xác cần để tải mỗi mô hình. Tính hằng ngày từ kích thước mô hình và bộ nhớ của card. Hiển thị 60 mô hình lớn nhất trong 107 mô hình chạy được.
DeepSeek Coder V2 Lite
by DeepSeek
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
16B (2B active)
Throughput
168 tok/s
Qwen2.5 14B
by Alibaba (Qwen Team)
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
15B
Throughput
27 tok/s
Qwen3 14B Base
by Alibaba (Qwen Team)
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
15B
Throughput
27 tok/s
Cogito V1 Preview Qwen 14B
by Deepcogito
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
15B
Throughput
27 tok/s
Qwen 3 14B
by Alibaba (Qwen Team)
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
15B
Throughput
27 tok/s
Qwen 2.5 14B
by Alibaba (Qwen Team)
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
15B
Throughput
27 tok/s
DeepSeek R1 Distill Qwen 14B
by DeepSeek
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
15B
Throughput
27 tok/s
Phi-4
by Microsoft
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
15B
Throughput
27 tok/s
?
INT4
Deepcoder 14B Preview
by Agentica
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
14B
Throughput
29 tok/s
Ministral 3 14B 2512
by Mistral AI
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
14B
Throughput
29 tok/s
Phi-3 Medium
by Microsoft
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
14B
Throughput
29 tok/s
Code Llama 13B
by Meta AI
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
13B
Throughput
31 tok/s
?
INT4
MythoMax 13B
by Gryphe
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
13B
Throughput
31 tok/s
LLaVA 13B
by LLaVA Project
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
13B
Context
4K tokens
Baichuan2-13B
by Baichuan Inc.
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
13B
Throughput
31 tok/s
?
INT4
ReMM SLERP 13B
by Undi95
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
13B
Throughput
31 tok/s
Mistral Nemo 12B
by Mistral AI
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
12B
Throughput
33 tok/s
FLUX.1 Dev
by Black Forest Labs
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
12B
FLUX.1 Schnell
by Black Forest Labs
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
12B
?
INT4
Rocinante 12B
by Thedrummer
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
12B
Throughput
34 tok/s
Llama Guard 4 12B
by Meta AI
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
12B
Throughput
34 tok/s
?
INT4
UnslopNemo 12B
by Thedrummer
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
12B
Throughput
34 tok/s
Gemma 4 12B It
by Google DeepMind
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
12B
Throughput
34 tok/s
Gemma 3 12B
by Google DeepMind
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
12B
Throughput
34 tok/s
Llama 3.2 11B Vision
by Meta AI
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
11B
Context
128K tokens
Qwen3.5-9B
by Alibaba (Qwen Team)
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
10B
Throughput
21 tok/s
Moondream 3.1
by Moondream
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
9B
Throughput
22 tok/s
Moondream 3 Preview
by Moondream
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
9B
Throughput
22 tok/s
Gemma 2 9B
by Google DeepMind
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
9B
Throughput
22 tok/s
Nemotron Nano 9B V2
by Nvidia
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
9B
Throughput
22 tok/s
Ministral 3 8B 2512
by Mistral AI
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
9B
Throughput
23 tok/s
granite-4.2-8b
by IBM Research
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
9B
Throughput
23 tok/s
Granite 4.1 8B
by IBM Research
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
9B
Throughput
23 tok/s
Qwen3 VL 8B Instruct
by Alibaba (Qwen Team)
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
9B
Throughput
23 tok/s
Qwen3 VL 8B Thinking
by Alibaba (Qwen Team)
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
9B
Throughput
23 tok/s
LFM2.5-8B-A1B
by Liquid AI
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
8B
Throughput
24 tok/s
Rnj 1 Instruct
by Essential AI
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
8B
Throughput
24 tok/s
?
FP8
UI-TARS 7B
by ByteDance (Seed team)
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
8B
Throughput
24 tok/s
Qwen 3 8B
by Alibaba (Qwen Team)
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
8B
Throughput
25 tok/s
Stable Diffusion 3.5 Large
by Stability AI
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
8B
Hy-MT2-7B
by Tencent
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
8B
Throughput
25 tok/s
Molmo 7B D 0924
by Allen Institute for AI (AI2)
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
8B
Throughput
25 tok/s
Llama 3 8B Instruct
by Meta AI
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
8B
Throughput
25 tok/s
Meta Llama 3.1 8B
by Meta AI
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
8B
Throughput
25 tok/s
Llama 3.1 8B
by Meta AI
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
8B
Throughput
25 tok/s
IBM Granite Code 8B
by IBM Research
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
8B
Throughput
25 tok/s
Cogito V1 Preview Llama 8B
by Deepcogito
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
8B
Throughput
25 tok/s
Qwen3 8B Base
by Alibaba (Qwen Team)
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
8B
Throughput
25 tok/s
?
FP8
Hermes 2 Pro - Llama-3 8B
by Nous Research
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
8B
Throughput
25 tok/s
?
FP8
Aion-RP 1.0 (8B)
by Aion Labs
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
8B
Throughput
25 tok/s
?
FP8
Hermes 3 8B
by Nous Research
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
8B
Throughput
25 tok/s
Llama Guard 3 8B
by Meta AI
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
8B
Throughput
25 tok/s
?
FP8
Llama 3 8B Lunaris
by Sao10k
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
8B
Throughput
25 tok/s
Ministral 8B
by Mistral AI
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
8B
Throughput
25 tok/s
IBM Granite 3.1 8B
by IBM Research
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
8B
Throughput
25 tok/s
Gemma 4 E4B-it
by Google DeepMind
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
8B
Throughput
25 tok/s
Qwen2.5 7B
by Alibaba (Qwen Team)
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
8B
Throughput
27 tok/s
Qwen 2 (7B)
by Alibaba (Qwen Team)
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
8B
Throughput
27 tok/s
Qwen 2.5 7B
by Alibaba (Qwen Team)
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
8B
Throughput
27 tok/s
DeepSeek R1 Distill Qwen 7B
by DeepSeek
Required GPUs
1× Nvidia RTX A2000 12GB
Tổng VRAM
12 GB
Parameters
8B
Throughput
27 tok/s
Renting for inference?
Pair these models with the cheapest provider on the rental table.
See rental rates on the Overview tab →
FAQ
AI models on this GPU.
What AI models can I run on a Nvidia RTX A2000 12GB?
The list above shows open-weights models whose memory need fits this card: on one card when the model uses at least a quarter of its 12 GB, or on 2, 4 or 8 of them when it is too large for one. Each row gives the fewest cards and the precision (FP16, FP8 or INT4) that load it.
What's the VRAM minimum to run a model on the Nvidia RTX A2000 12GB?
We count the weights (parameters × bytes per weight: FP16 = 2, FP8 = 1, INT4 = 0.5), add the KV cache for an 8K-token context, and add 15% for the runtime. A model fits when that is within 90% of the cards' memory. A 70B model needs about 164 GB at FP16 and about 43 GB at INT4. A longer context needs more.
How does quantization (FP16 vs FP8 vs INT4) affect what fits?
Lower-precision quantization shrinks the memory footprint nearly linearly with the bit count. The trade-off is output quality: FP16 is the reference, FP8 is usually indistinguishable for most prompts, INT8 introduces small quality losses, INT4 is noticeably degraded on reasoning-heavy tasks but fine for chat. The badge on each row tells you which level the recommendation assumes.
Can I fine-tune on the Nvidia RTX A2000 12GB or only do inference?
The rows here are for inference. Full fine-tuning needs several times more memory than inference at the same model size, because gradients, optimizer state and activations all live in memory. LoRA and QLoRA cut that a lot. The fine-tune cost tool sizes a run for you.
How are these GPU counts worked out?
We compute them every day from the model's parameter count and the card's memory, with the formula above. They are estimates, not tests we ran. Tokens per second, where shown, is an estimate from the card's memory bandwidth on one card.