Nvidia logo Thuê Nvidia RTX 4500Ada.

Ada Lovelace 24GB VRAM 210W From $0.40/hr
Per hour
$0.40
Per day
$9.57
Per week
$66.98
Per month
$287
AI models

Models that run on this GPU.

Các mô hình mở trọng số chạy được trên card này để suy luận, với số card ít nhất và độ chính xác cần để tải mỗi mô hình. Tính hằng ngày từ kích thước mô hình và bộ nhớ của card. Hiển thị 60 mô hình lớn nhất trong 229 mô hình chạy được.

?

Thinking Machines: Inkling Small

by Thinking Machines
INT4
Required GPUs
8× Nvidia RTX 4500Ada
Tổng VRAM
192 GB
Parameters
266B
Context
524K tokens

DeepSeek Coder V2 236B

by DeepSeek
INT4
Required GPUs
8× Nvidia RTX 4500Ada
Tổng VRAM
192 GB
Parameters
236B (21B active)
Context
128K tokens

Qwen: Qwen3 235B A22B Instruct 2507

by Alibaba (Qwen Team)
INT4
Required GPUs
8× Nvidia RTX 4500Ada
Tổng VRAM
192 GB
Parameters
235B
Context
262K tokens

Qwen 3 235B

by Alibaba (Qwen Team)
INT4
Required GPUs
8× Nvidia RTX 4500Ada
Tổng VRAM
192 GB
Parameters
235B (22B active)
Context
131K tokens

Qwen: Qwen3 VL 235B A22B Thinking

by Alibaba (Qwen Team)
INT4
Required GPUs
8× Nvidia RTX 4500Ada
Tổng VRAM
192 GB
Parameters
235B
Context
1M tokens

Qwen: Qwen3 Max

by Alibaba (Qwen Team)
INT4
Required GPUs
8× Nvidia RTX 4500Ada
Tổng VRAM
192 GB
Parameters
235B
Context
262K tokens

Qwen: Qwen3 235B A22B Thinking 2507

by Alibaba (Qwen Team)
INT4
Required GPUs
8× Nvidia RTX 4500Ada
Tổng VRAM
192 GB
Parameters
235B
Context
1M tokens

Qwen: Qwen3 VL 235B A22B Instruct

by Alibaba (Qwen Team)
INT4
Required GPUs
8× Nvidia RTX 4500Ada
Tổng VRAM
192 GB
Parameters
235B
Context
262K tokens

MiniMax: MiniMax M2.5

by MiniMax
INT4
Required GPUs
8× Nvidia RTX 4500Ada
Tổng VRAM
192 GB
Parameters
230B
Context
205K tokens

MiniMax: MiniMax M2.7

by MiniMax
INT4
Required GPUs
8× Nvidia RTX 4500Ada
Tổng VRAM
192 GB
Parameters
230B
Context
205K tokens

MiniMax: MiniMax M2.1

by MiniMax
INT4
Required GPUs
8× Nvidia RTX 4500Ada
Tổng VRAM
192 GB
Parameters
230B
Context
205K tokens

MiniMax: MiniMax M2

by MiniMax
INT4
Required GPUs
8× Nvidia RTX 4500Ada
Tổng VRAM
192 GB
Parameters
229B
Context
205K tokens

MiniMax: MiniMax M3.1 Flash

by MiniMax
INT4
Required GPUs
8× Nvidia RTX 4500Ada
Tổng VRAM
192 GB
Parameters
220B
Context
1M tokens

StepFun: Step 3.7 Flash

by StepFun
INT4
Required GPUs
8× Nvidia RTX 4500Ada
Tổng VRAM
192 GB
Parameters
201B
Context
256K tokens
?

Seed-1.8

by ByteDance (Seed team)
INT4
Required GPUs
8× Nvidia RTX 4500Ada
Tổng VRAM
192 GB
Parameters
200B
Context
256K tokens

StepFun: Step 3.5 Flash

by StepFun
INT4
Required GPUs
8× Nvidia RTX 4500Ada
Tổng VRAM
192 GB
Parameters
199B
Context
262K tokens

Mixtral 8x22B

by Mistral AI
FP8
Required GPUs
8× Nvidia RTX 4500Ada
Tổng VRAM
192 GB
Parameters
141B (39B active)
Context
66K tokens

Mistral: Devstral 2 2512

by Mistral AI
INT4
Required GPUs
4× Nvidia RTX 4500Ada
Tổng VRAM
96 GB
Parameters
128B
Context
262K tokens
?

Ling-3.0-flash

by Inclusionai
INT4
Required GPUs
4× Nvidia RTX 4500Ada
Tổng VRAM
96 GB
Parameters
127B
Context
131K tokens
?

Ling 3.0 Flash Fin

by Inclusionai
INT4
Required GPUs
4× Nvidia RTX 4500Ada
Tổng VRAM
96 GB
Parameters
127B
Context
256K tokens
?

Ling-3.0-flash-VL

by Inclusionai
INT4
Required GPUs
4× Nvidia RTX 4500Ada
Tổng VRAM
96 GB
Parameters
125B
Context
131K tokens

Mistral Large 2

by Mistral AI
INT4
Required GPUs
4× Nvidia RTX 4500Ada
Tổng VRAM
96 GB
Parameters
123B
Context
128K tokens

Qwen: Qwen3.5-122B-A10B

by Alibaba (Qwen Team)
INT4
Required GPUs
4× Nvidia RTX 4500Ada
Tổng VRAM
96 GB
Parameters
122B
Context
262K tokens

Mistral: Mistral Small 4

by Mistral AI
INT4
Required GPUs
4× Nvidia RTX 4500Ada
Tổng VRAM
96 GB
Parameters
121B
Context
262K tokens

NVIDIA: Nemotron 3 Super

by Nvidia
INT4
Required GPUs
4× Nvidia RTX 4500Ada
Tổng VRAM
96 GB
Parameters
120B
Context
1M tokens

GPT-OSS 120B

by OpenAI
INT4
Required GPUs
4× Nvidia RTX 4500Ada
Tổng VRAM
96 GB
Parameters
120B (5B active)
Context
128K tokens
?

Poolside: Laguna S 2.1

by Poolside
INT4
Required GPUs
4× Nvidia RTX 4500Ada
Tổng VRAM
96 GB
Parameters
118B
Context
1M tokens

Llama 4 Scout (17Bx16E)

by Meta AI
INT4
Required GPUs
4× Nvidia RTX 4500Ada
Tổng VRAM
96 GB
Parameters
109B
Context
262K tokens

Meta: Llama 4 Scout

by Meta AI
INT4
Required GPUs
4× Nvidia RTX 4500Ada
Tổng VRAM
96 GB
Parameters
109B
Context
10M tokens

Z.ai: GLM 4.5V

by Zhipu AI
INT4
Required GPUs
4× Nvidia RTX 4500Ada
Tổng VRAM
96 GB
Parameters
108B
Context
66K tokens

Z.ai: GLM 4.6V

by Zhipu AI
INT4
Required GPUs
4× Nvidia RTX 4500Ada
Tổng VRAM
96 GB
Parameters
108B
Context
131K tokens
?

inclusionAI: Ling-2.6-flash

by Inclusionai
INT4
Required GPUs
4× Nvidia RTX 4500Ada
Tổng VRAM
96 GB
Parameters
107B
Context
262K tokens
?

Prime Intellect: INTELLECT-3

by Prime Intellect
INT4
Required GPUs
4× Nvidia RTX 4500Ada
Tổng VRAM
96 GB
Parameters
107B
Context
131K tokens

GLM-4.5-Air

by Zhipu AI
INT4
Required GPUs
4× Nvidia RTX 4500Ada
Tổng VRAM
96 GB
Parameters
106B (12B active)
Context
128K tokens

Command R+

by Cohere
INT4
Required GPUs
4× Nvidia RTX 4500Ada
Tổng VRAM
96 GB
Parameters
104B
Context
128K tokens

Llama 3.2 90B Vision

by Meta AI
INT4
Required GPUs
4× Nvidia RTX 4500Ada
Tổng VRAM
96 GB
Parameters
90B
Context
128K tokens

Qwen: Qwen3 Next 80B A3B Thinking

by Alibaba (Qwen Team)
INT4
Required GPUs
4× Nvidia RTX 4500Ada
Tổng VRAM
96 GB
Parameters
80B
Context
262K tokens

Qwen: Qwen3 Next 80B A3B Instruct

by Alibaba (Qwen Team)
INT4
Required GPUs
4× Nvidia RTX 4500Ada
Tổng VRAM
96 GB
Parameters
80B
Context
262K tokens

Tencent: Hunyuan A13B Instruct

by Tencent
INT4
Required GPUs
4× Nvidia RTX 4500Ada
Tổng VRAM
96 GB
Parameters
80B
Context
131K tokens

Qwen: Qwen3 Coder Next

by Alibaba (Qwen Team)
INT4
Required GPUs
4× Nvidia RTX 4500Ada
Tổng VRAM
96 GB
Parameters
80B
Context
262K tokens

Arcee AI: Virtuoso Large

by Arcee AI
INT4
Required GPUs
4× Nvidia RTX 4500Ada
Tổng VRAM
96 GB
Parameters
73B
Context
131K tokens

Qwen 2.5 72B

by Alibaba (Qwen Team)
INT4
Required GPUs
4× Nvidia RTX 4500Ada
Tổng VRAM
96 GB
Parameters
73B
Context
131K tokens

Qwen2 72B Instruct

by Alibaba (Qwen Team)
FP8
Required GPUs
4× Nvidia RTX 4500Ada
Tổng VRAM
96 GB
Parameters
72B
Context
33K tokens

Qwen 2 (72B)

by Alibaba (Qwen Team)
FP8
Required GPUs
4× Nvidia RTX 4500Ada
Tổng VRAM
96 GB
Parameters
72B
Context
33K tokens

Qwen: Qwen2.5 VL 72B Instruct

by Alibaba (Qwen Team)
FP8
Required GPUs
4× Nvidia RTX 4500Ada
Tổng VRAM
96 GB
Parameters
72B
Context
131K tokens
?

Magnum v4 72B

by Anthracite Org
FP8
Required GPUs
4× Nvidia RTX 4500Ada
Tổng VRAM
96 GB
Parameters
72B
Context
33K tokens

Qwen2.5 72B

by Alibaba (Qwen Team)
FP8
Required GPUs
4× Nvidia RTX 4500Ada
Tổng VRAM
96 GB
Parameters
72B
Context
131K tokens

Qwen2-VL (72B) Instruct

by Alibaba (Qwen Team)
FP8
Required GPUs
4× Nvidia RTX 4500Ada
Tổng VRAM
96 GB
Parameters
72B
Context
33K tokens

Cogito V1 Preview Llama 70B

by Deepcogito
FP8
Required GPUs
4× Nvidia RTX 4500Ada
Tổng VRAM
96 GB
Parameters
70B
Context
131K tokens
?

Sao10K: Llama 3.1 70B Hanami x1

by Sao10k
FP8
Required GPUs
4× Nvidia RTX 4500Ada
Tổng VRAM
96 GB
Parameters
70B
Context
16K tokens
?

Nous: Hermes 4 70B

by Nous Research
FP8
Required GPUs
4× Nvidia RTX 4500Ada
Tổng VRAM
96 GB
Parameters
70B
Context
131K tokens
?

Sao10K: Llama 3.3 Euryale 70B

by Sao10k
FP8
Required GPUs
4× Nvidia RTX 4500Ada
Tổng VRAM
96 GB
Parameters
70B
Context
131K tokens

Llama 3.1 Nemotron 70B Instruct HF

by Nvidia
FP8
Required GPUs
4× Nvidia RTX 4500Ada
Tổng VRAM
96 GB
Parameters
70B
Context
33K tokens
?

Sao10k: Llama 3 Euryale 70B v2.1

by Sao10k
FP8
Required GPUs
4× Nvidia RTX 4500Ada
Tổng VRAM
96 GB
Parameters
70B
Context
8K tokens

Meta: Llama 3 70B Instruct

by Meta AI
FP8
Required GPUs
4× Nvidia RTX 4500Ada
Tổng VRAM
96 GB
Parameters
70B
Context
8K tokens

Code Llama 70B

by Meta AI
FP8
Required GPUs
4× Nvidia RTX 4500Ada
Tổng VRAM
96 GB
Parameters
70B
Context
16K tokens

Llama 3.3 70B

by Meta AI
FP8
Required GPUs
4× Nvidia RTX 4500Ada
Tổng VRAM
96 GB
Parameters
70B
Context
128K tokens

DeepSeek R1 Distill Llama 70B

by DeepSeek
FP8
Required GPUs
4× Nvidia RTX 4500Ada
Tổng VRAM
96 GB
Parameters
70B
Context
128K tokens

Llama 3.1 70B

by Meta AI
FP8
Required GPUs
4× Nvidia RTX 4500Ada
Tổng VRAM
96 GB
Parameters
70B
Context
131K tokens
?

Hermes 3 70B

by Nous Research
FP8
Required GPUs
4× Nvidia RTX 4500Ada
Tổng VRAM
96 GB
Parameters
70B
Context
128K tokens
Renting for inference?
Pair these models with the cheapest provider on the rental table. See rental rates on the Overview tab →
FAQ

AI models on this GPU.

What AI models can I run on a Nvidia RTX 4500Ada?
The list above shows open-weights models whose memory need fits this card: on one card when the model uses at least a quarter of its 24 GB, or on 2, 4 or 8 of them when it is too large for one. Each row gives the fewest cards and the precision (FP16, FP8 or INT4) that load it.
What's the VRAM minimum to run a model on the Nvidia RTX 4500Ada?
We count the weights (parameters × bytes per weight: FP16 = 2, FP8 = 1, INT4 = 0.5), add the KV cache for an 8K-token context, and add 15% for the runtime. A model fits when that is within 90% of the cards' memory. A 70B model needs about 164 GB at FP16 and about 43 GB at INT4. A longer context needs more.
How does quantization (FP16 vs FP8 vs INT4) affect what fits?
Lower-precision quantization shrinks the memory footprint nearly linearly with the bit count. The trade-off is output quality: FP16 is the reference, FP8 is usually indistinguishable for most prompts, INT8 introduces small quality losses, INT4 is noticeably degraded on reasoning-heavy tasks but fine for chat. The badge on each row tells you which level the recommendation assumes.
Can I fine-tune on the Nvidia RTX 4500Ada or only do inference?
The rows here are for inference. Full fine-tuning needs several times more memory than inference at the same model size, because gradients, optimizer state and activations all live in memory. LoRA and QLoRA cut that a lot. The fine-tune cost tool sizes a run for you.
How are these GPU counts worked out?
We compute them every day from the model's parameter count and the card's memory, with the formula above. They are estimates, not tests we ran. Tokens per second, where shown, is an estimate from the card's memory bandwidth on one card.