datacenter
Thuê Nvidia A100 SXM 40GB.
Ampere
40GB VRAM
From $1.00/hr
Per hour
$1.00
Per day
$24.00
Per week
$168.00
Per month
$720
Price history
Daily median across providers.
Loading...
Where to rent it
All providers carrying this GPU.
FAQ
Frequently asked.
How much does it cost to rent the Nvidia A100 SXM 40GB right now?
The cheapest current listing is $1.00/hr on RunPod, the only provider listing it right now. Running one around the clock for a month (730 hours) at the cheapest rate costs about $730.
What AI models can the Nvidia A100 SXM 40GB run?
With 40 GB it runs 7–8B models at FP16, 13–14B at INT8 and about 32B at 4-bit. A 70B model needs a 48 GB card or two 40 GB cards. It can QLoRA fine-tune 7–14B models.
Which models are recommended for the Nvidia A100 SXM 40GB?
6 models in our catalog have a recommended configuration for this card, with the quantization that fits its 40 GB — see the AI models tab.
Why does the Nvidia A100 SXM 40GB cost different amounts on different providers?
Marketplaces such as Vast.ai and Clore.ai list machines from independent hosts who set their own prices, so competition pushes rates down but reliability varies by host. Operator clouds such as Lambda and the hyperscalers charge more for consistent hardware, support and networking. Prices here are per GPU, so they compare directly.
How is the Nvidia A100 SXM 40GB price calculated?
We collect listings from each provider's public API or price page — every 5–10 minutes for marketplaces, up to daily for operator clouds — and show the median hourly price per provider from the last 24 hours, so one unusually cheap listing doesn't set the headline. Details are on the methodology page.
AI models
INT4
INT4
INT4
INT4
INT4
Models that run on this GPU.
GPU-count + quantization recommendations covering fine-tuning, inference, and run-it-yourself scenarios on the Nvidia A100 SXM 40GB.
nim/nvidia/llama-3.3-nemotron-super-49b-v1
by Nvidia
Required GPUs
1× Nvidia A100 SXM 40GB
Total VRAM
40 GB
Parameters
49B
Context
16K tokens
NVIDIA: Llama 3.3 Nemotron Super 49B V1.5
by Nvidia
Required GPUs
1× Nvidia A100 SXM 40GB
Total VRAM
40 GB
Parameters
49B
Context
131K tokens
?
INT4
TheDrummer: Skyfall 36B V2
by Thedrummer
Required GPUs
1× Nvidia A100 SXM 40GB
Total VRAM
40 GB
Parameters
36B
Context
33K tokens
Qwen3.6 35B A3b Fp8
by Alibaba (Qwen Team)
Required GPUs
1× Nvidia A100 SXM 40GB
Total VRAM
40 GB
Parameters
35B
Context
262K tokens
Qwen: Qwen3.5-35B-A3B
by Alibaba (Qwen Team)
Required GPUs
1× Nvidia A100 SXM 40GB
Total VRAM
40 GB
Parameters
35B
Context
262K tokens
Qwen: Qwen3.6 35B A3B
by Alibaba (Qwen Team)
Required GPUs
1× Nvidia A100 SXM 40GB
Total VRAM
40 GB
Parameters
35B
Context
262K tokens
Renting for inference?
Pair these models with the cheapest provider on the rental table.
See rental rates on the Overview tab →
FAQ
AI models on this GPU.
How much does it cost to rent the Nvidia A100 SXM 40GB right now?
The cheapest current listing is $1.00/hr on RunPod, the only provider listing it right now. Running one around the clock for a month (730 hours) at the cheapest rate costs about $730.
What AI models can the Nvidia A100 SXM 40GB run?
With 40 GB it runs 7–8B models at FP16, 13–14B at INT8 and about 32B at 4-bit. A 70B model needs a 48 GB card or two 40 GB cards. It can QLoRA fine-tune 7–14B models.
Which models are recommended for the Nvidia A100 SXM 40GB?
6 models in our catalog have a recommended configuration for this card, with the quantization that fits its 40 GB — see the AI models tab.
Why does the Nvidia A100 SXM 40GB cost different amounts on different providers?
Marketplaces such as Vast.ai and Clore.ai list machines from independent hosts who set their own prices, so competition pushes rates down but reliability varies by host. Operator clouds such as Lambda and the hyperscalers charge more for consistent hardware, support and networking. Prices here are per GPU, so they compare directly.
How is the Nvidia A100 SXM 40GB price calculated?
We collect listings from each provider's public API or price page — every 5–10 minutes for marketplaces, up to daily for operator clouds — and show the median hourly price per provider from the last 24 hours, so one unusually cheap listing doesn't set the headline. Details are on the methodology page.