Louer Nvidia A100 SXM4.

The cheapest current listing is $0.72/hr on Nosana, and the median across the 5 providers listing it is $1.50/hr. Running one around the clock for a month (730 hours) at the cheapest rate costs about $523.

With 80 GB it holds a 70B model at INT8/FP8 (about 70 GB of weights) on one card, or at 4-bit with plenty of room for long contexts and many concurrent requests. It can QLoRA fine-tune 70B models. FP16 70B (about 140 GB) needs two cards.

Marketplaces such as Vast.ai and Clore.ai list machines from independent hosts who set their own prices, so competition pushes rates down but reliability varies by host. Operator clouds such as Lambda and the hyperscalers charge more for consistent hardware, support and networking. Prices here are per GPU, so they compare directly.

Neither. Renting a GPU is on-demand: the rate is per hour the card is allocated to you — whether it is running your job or sitting idle — and most providers bill per second and stop billing the moment you stop the instance. There is no weekly or monthly plan to commit to (the monthly figure we show is simply 730 × the hourly rate), and nothing is metered by usage. Usage-based pricing — per-token rates with limits like TPM or concurrency — is how hosted model APIs charge, which is a different product we track on our AI-model pages, not here.

We collect listings from each provider's public API or price page — every 5–10 minutes for marketplaces, up to daily for operator clouds — and show the median hourly price per provider from the last 24 hours, so one unusually cheap listing doesn't set the headline. Details are on the methodology page.