Microsoft Azure.
ND/NC/NV-series VMs covering A100, H100, H200, MI300X. Tight integration with Azure ML and OpenAI Service. Reserved Instances and Spot VMs offer up to 90% off list price.
At a glance
- Business model
- Hyperscalers
- Tier
- Hyperscaler
- Headquarters
- US
Every Microsoft Azure configuration we track
Per-GPU price is the comparable number; the instance total is what you're billed for the whole machine. Storage, extra vCPU, and egress are priced separately by most providers.
| GPU | Configuration | GPUs | $/GPU/hr |
|---|---|---|---|
| NC40ads_H100_v5 | 1 | $6.98/hr | |
| NC80adis_H100_v5 | 2 | $6.98/hr | |
| ND96isr_H100_v5 | 8 | $12.29/hr | |
| ND96isr_H200_v5 | 8 | $10.60/hr | |
| ND96asr_v4 | 8 | $3.40/hr | |
| ND96amsr_A100_v4 | 8 | $4.10/hr | |
| ND40rs_v2 | 8 | $2.75/hr | |
| ND96isr_MI300X_v5 | 8 | $6.00/hr | |
| NC24ads_A100_v4 | 1 | $3.67/hr | |
| NC48ads_A100_v4 | 2 | $3.67/hr | |
| NC96ads_A100_v4 | 4 | $3.67/hr | |
| NC6s_v3 | 1 | $3.06/hr | |
| NC12s_v3 | 2 | $3.06/hr | |
| NC24s_v3 | 4 | $3.06/hr | |
| NC24rs_v3 | 4 | $3.36/hr | |
| NV36ads_A10_v5 | 1 | $3.20/hr | |
| NC32ads_A10_v4 | 1 | $4.40/hr | |
| NV72ads_A10_v5 | 2 | $3.26/hr | |
| NC4as_T4_v3 | 1 | $0.53/hr | |
| NC8as_T4_v3 | 1 | $0.75/hr | |
| NC16as_T4_v3 | 1 | $1.20/hr | |
| NC64as_T4_v3 | 4 | $1.09/hr |
When to pick Microsoft Azure
Best for
- Enterprise customers already on AWS/GCP/Azure/Oracle.
- Multi-region deployments and complex compliance setups.
- Workloads tightly coupled to other cloud services (S3, BigQuery, etc.).
Avoid for
- Cost-sensitive workloads — hyperscaler pricing is the highest tier.
- Anyone who doesn't already need the surrounding cloud platform.
Daily median on Microsoft Azure's top GPUs.
GPUs available on Microsoft Azure
Compare with peers
Other providers in the same bucket — quick way to sanity-check pricing before committing.
EC2 GPU instances (p4, p5, g5, g6) on the largest cloud network. Reserved + Savings Plan discounts available; spot prices fluctuate by region. Best fit when ...
Compute Engine A2/A3 (A100, H100), G2 (L4), and TPU instances. First-class integration with Vertex AI for managed training and serving. Sustained-use discoun...
Bare-metal and VM GPU shapes (A10, A100, H100, H200) with RDMA cluster networking that often beats other hyperscalers on $/GPU-hour for large training jobs.
Cloud GPU + Bare Metal GPU instances. Globally distributed datacenters (32 regions), per-hour billing, transparent published pricing. Sweet spot for teams wa...