NVIDIA A100 40GB SXM rental price
Median $1.99/GPU-hr on-demand · $0.70/GPU-hr spot · across 3 providers · Updated 2026-08-11 02:50 UTC · Anatomy ↓
Price history
Each point is the daily cross-provider median for this SKU and pricing type (per-provider medians first, so no marketplace’s volume dominates). Gaps are gaps — we don’t interpolate missing data.
Dashed/hollow points before 2026-08-09: archival reconstruction from dated provider pricing-page snapshots (see methodology) — fewer providers, monthly resolution.
The spread: the same NVIDIA A100 40GB SXM ranges from $0.84 to $3.40 per hour across tracked providers right now — a 4.0× difference. This is why we exist.
Where to rent it
| Provider | Type | Region | $/GPU-hr | Seen |
|---|---|---|---|---|
 Vast.ai | Spot | CZ | $0.50 | 2026-08-10 21:56 UTC |
 DataCrunch | Spot | — | $0.65 | 2026-08-11 02:50 UTC |
 Azure | Spot | eastus | $0.75 | 2026-08-11 02:50 UTC |
| Vast.ai | On-demand | US | $0.84 | 2026-08-10 18:02 UTC |
 RunPod | Community | — | $1.00 | 2026-08-11 02:50 UTC |
| DataCrunch | On-demand | — | $1.29 | 2026-08-11 02:50 UTC |
 Lambda | On-demand | — | $1.99 | 2026-08-11 02:50 UTC |
| Azure | On-demand | eastus | $3.40 | 2026-08-11 02:50 UTC |
Prices are as listed by providers at scrape time; availability at a listed price isn’t guaranteed. Links marked ↗ may be affiliate links — they never affect prices shown or ordering.
Anatomy: why it costs this
Everything that has to exist before one A100 40GB SXM-hour can be rented — then the arithmetic on the parts that can be priced honestly.
Power basis: published full-system wall power (DGX A100: 6.5 kW ÷ 8) × PUE 1.54 × 8.71¢/kWh (1.25 kWh from the grid). Water bounded at 1.8 L/kWh and $5/m³ — deliberately high. The residual is hardware amortization, facility, staff, and margin — presented as a residual because vendors don’t publish server street prices, and we don’t print numbers we can’t stand behind.
Verified inputs & sources
- NVIDIA A100 40GB SXM power basis: 0.8125 kW — NVIDIA specifications
- US industrial electricity, average retail: 0.0871 $/kWh — EIA Electric Power Monthly (May 2026, preliminary) (checked 2026-08-10)
- Industry average PUE: 1.54 × — Uptime Institute Global Survey 2025 (weighted avg; ~flat six years) (checked 2026-08-10)
- Best-in-class fleet PUE (Google, 2025): 1.09 × — Google data center efficiency (2025 fleet average) (checked 2026-08-10)
- Water usage effectiveness, evaporative-cooling upper range: 1.8 L/kWh — Operator-reported WUE ranges (~0.2 hyperscaler best → ~1.8 evaporative) (checked 2026-08-10)
- Industrial water price, generous upper bound: 5 $/m³ — Upper-bound assumption (US industrial rates are typically well below this) (checked 2026-08-10)
- Reference context with the arithmetic shown — never fed into the Index or any published series (see methodology).
One email when the NVIDIA A100 40GB SXM daily median hits your number. No account, one-shot, the alert retires after it fires.
Last scrape: 2026-08-11 02:51 UTC · 654 observations today across 8 providers · Failures logged, never interpolated.
Know what a GPU-hour costs before everyone else does.
One email a week: what moved, why, and where the spreads are. No sponsors choosing the content.
Free forever. Unsubscribe anytime.