datacenter
Louer NVIDIA A40.
Ampere
48GB VRAM
From $0.32/hr
Per hour
$0.32
Per day
$7.64
Per week
$53.46
Per month
$229
Provider spread
2 providers ·
up to 9% cheaper at the low end
Cheapest · $0.32/hr on Nosana
Median $0.33/hr
Most expensive · $0.35/hr on RunPod
Price history
Daily median across providers.
Loading...
Where to rent it
All providers carrying this GPU.
FAQ
Frequently asked.
How much does it cost to rent the NVIDIA A40 right now?
The cheapest current listing is $0.32/hr on Nosana, and the median across the 2 providers listing it is $0.35/hr. Running one around the clock for a month (730 hours) at the cheapest rate costs about $232.
What AI models can the NVIDIA A40 run?
With 48 GB it runs 70B models at 4-bit (about 35–40 GB of weights plus KV cache) and 32B models at INT8. It can QLoRA fine-tune models up to about 70B with short sequences, and 32B comfortably.
Which models are recommended for the NVIDIA A40?
53 models in our catalog have a recommended configuration for this card, with the quantization that fits its 48 GB — see the AI models tab.
Why does the NVIDIA A40 cost different amounts on different providers?
Marketplaces such as Vast.ai and Clore.ai list machines from independent hosts who set their own prices, so competition pushes rates down but reliability varies by host. Operator clouds such as Lambda and the hyperscalers charge more for consistent hardware, support and networking. Prices here are per GPU, so they compare directly.
How is the NVIDIA A40 price calculated?
We collect listings from each provider's public API or price page — every 5–10 minutes for marketplaces, up to daily for operator clouds — and show the median hourly price per provider from the last 24 hours, so one unusually cheap listing doesn't set the headline. Details are on the methodology page.
AI models
INT4
FP16
FP16
FP16
FP16
INT4
INT4
INT4
INT4
INT4
FP8
FP8
FP8
FP8
FP8
FP8
FP8
FP8
FP8
FP8
FP8
FP8
INT4
INT4
INT4
INT4
INT4
INT4
INT4
INT4
INT4
INT4
INT4
INT4
INT4
INT4
INT4
INT4
INT4
INT4
INT4
INT4
Models that run on this GPU.
GPU-count + quantization recommendations covering fine-tuning, inference, and run-it-yourself scenarios on the NVIDIA A40.
Qwen 2.5 72B
by Alibaba (Qwen Team)
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
73B
Context
128K tokens
Llama 4 Scout 17B 16E Instruct Fp8 Lora
by Meta AI
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
17B
Context
10.5M tokens
Llama 4 Maverick Instruct (17Bx128E) FP8
by Meta AI
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
17B
Context
1M tokens
Llama 4 Scout (17Bx16E)
by Meta AI
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
17B
Context
262K tokens
Llama 4 Scout Instruct (17Bx16E)
by Meta AI
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
17B
Context
1M tokens
Qwen2.5 72B Instruct
by Alibaba (Qwen Team)
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
72B
Context
33K tokens
Qwen2 72B Instruct
by Togethercomputer
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
72B
Context
33K tokens
Qwen2.5 72B Instruct Turbo
by Alibaba (Qwen Team)
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
72B
Context
131K tokens
Qwen2-VL (72B) Instruct
by Alibaba (Qwen Team)
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
72B
Context
33K tokens
Qwen: Qwen2.5 VL 72B Instruct
by Alibaba (Qwen Team)
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
72B
Context
131K tokens
Qwen 2.5 Coder 32B
by Alibaba (Qwen Team)
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
33B
Context
128K tokens
DeepSeek R1 Distill Qwen 32B
by DeepSeek
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
33B
Context
128K tokens
Qwen 2.5 32B
by Alibaba (Qwen Team)
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
33B
Context
128K tokens
Qwen 3 32B
by Alibaba (Qwen Team)
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
33B
Context
128K tokens
LLaVA 34B
by LLaVA Project
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
34B
Context
4K tokens
Code Llama 34B
by Meta AI
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
34B
Context
16K tokens
DeepSeek Coder 33B
by DeepSeek
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
33B
Context
16K tokens
Yi-34B
by 01.AI
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
34B
Context
32K tokens
Qwen: Qwen3.6 35B A3B
by Alibaba (Qwen Team)
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
35B
Context
262K tokens
Qwen: Qwen3.5-35B-A3B
by Alibaba (Qwen Team)
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
35B
Context
262K tokens
?
FP8
TheDrummer: Skyfall 36B V2
by Thedrummer
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
36B
Context
33K tokens
?
FP8
Holo3 35B A3b
by Hcompany
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
35B
Context
262K tokens
Deepseek Coder 33B Instruct
by DeepSeek
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
33B
Context
16K tokens
Qwen3.6 35B A3b Fp8
by Alibaba (Qwen Team)
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
35B
Context
262K tokens
Llama 3.3 70B
by Meta AI
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
70B
Context
128K tokens
DeepSeek R1 Distill Llama 70B
by DeepSeek
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
70B
Context
128K tokens
Llama 3.1 70B
by Meta AI
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
70B
Context
128K tokens
Code Llama 70B
by Meta AI
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
70B
Context
16K tokens
?
INT4
Hermes 3 70B
by Nous Research
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
70B
Context
128K tokens
?
INT4
Nous: Hermes 4 70B
by Nous Research
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
70B
Context
131K tokens
?
INT4
Sao10K: Llama 3.1 70B Hanami x1
by Sao10k
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
70B
Context
16K tokens
?
INT4
Sao10K: Llama 3.3 Euryale 70B
by Sao10k
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
70B
Context
131K tokens
?
INT4
Magnum v4 72B
by Anthracite Org
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
72B
Context
33K tokens
?
INT4
Sao10K: Llama 3.1 Euryale 70B v2.2
by Sao10k
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
70B
Context
131K tokens
?
INT4
Sao10k: Llama 3 Euryale 70B v2.1
by Sao10k
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
70B
Context
8K tokens
Meta: Llama 3 70B Instruct
by Meta AI
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
70B
Context
8K tokens
Meta Llama 3.3 70B Instruct Turbo
by Meta AI
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
70B
Context
131K tokens
Meta Llama 3.1 70B Instruct Turbo
by Meta AI
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
70B
Context
131K tokens
nim/meta/llama-3.1-70b-instruct
by Meta AI
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
70B
Context
16K tokens
nim/nvidia/llama-3.1-nemotron-70b-instruct
by Nvidia
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
70B
Context
16K tokens
Cogito V1 Preview Llama 70B
by Deepcogito
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
70B
Context
131K tokens
Cogito V1 Preview Llama 70B Turbo
by Deepcogito
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
70B
Context
131K tokens
Qwen 2 (72B)
by Alibaba (Qwen Team)
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
72B
Context
33K tokens
Qwen2.5 72B
by Alibaba (Qwen Team)
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
72B
Context
131K tokens
Llama 3.1 70B
by Meta AI
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
70B
Context
131K tokens
Meta Llama 3 70B Instruct Turbo
by Meta AI
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
70B
Context
8K tokens
nim/meta/llama-3.3-70b-instruct
by Meta AI
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
70B
Context
16K tokens
Llama 3.1 Nemotron 70B Instruct HF
by Nvidia
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
70B
Context
33K tokens
meta-llama/Llama-3.3-70B-Instruct
by Meta AI
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
70B
Context
131K tokens
Llama 3.3 70B Instruct FP8 Lora
by Meta AI
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
70B
Context
131K tokens
?
INT4
Hermes-3-Llama-3.1-70B
by Nous Research
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
70B
Context
131K tokens
?
INT4
L3.1-70B-Euryale-v2.2
by Sao10k
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
70B
Context
131K tokens
Meta-Llama-3.1-70B-Instruct
by Meta AI
Required GPUs
1× NVIDIA A40
Total VRAM
48 GB
Parameters
70B
Context
131K tokens
Renting for inference?
Pair these models with the cheapest provider on the rental table.
See rental rates on the Overview tab →
FAQ
AI models on this GPU.
How much does it cost to rent the NVIDIA A40 right now?
The cheapest current listing is $0.32/hr on Nosana, and the median across the 2 providers listing it is $0.35/hr. Running one around the clock for a month (730 hours) at the cheapest rate costs about $232.
What AI models can the NVIDIA A40 run?
With 48 GB it runs 70B models at 4-bit (about 35–40 GB of weights plus KV cache) and 32B models at INT8. It can QLoRA fine-tune models up to about 70B with short sequences, and 32B comfortably.
Which models are recommended for the NVIDIA A40?
53 models in our catalog have a recommended configuration for this card, with the quantization that fits its 48 GB — see the AI models tab.
Why does the NVIDIA A40 cost different amounts on different providers?
Marketplaces such as Vast.ai and Clore.ai list machines from independent hosts who set their own prices, so competition pushes rates down but reliability varies by host. Operator clouds such as Lambda and the hyperscalers charge more for consistent hardware, support and networking. Prices here are per GPU, so they compare directly.
How is the NVIDIA A40 price calculated?
We collect listings from each provider's public API or price page — every 5–10 minutes for marketplaces, up to daily for operator clouds — and show the median hourly price per provider from the last 24 hours, so one unusually cheap listing doesn't set the headline. Details are on the methodology page.