Index144.4
12 live
GPUs / NVIDIA A100 40GB SXM · HBM2 · 40 GB

NVIDIA A100 40GB SXM rental price

An NVIDIA A100 40GB SXM costs $1.99 per GPU-hour today, the median of 5 providers. The cheapest tracked listing is $0.69, the most expensive $3.40 — a 4.9× difference.

On-demand
$1.99
Spot
$0.75
Spread
4.9×
$/petaFLOP-hr
$6.38
Providers
5
Updated 2026-11-22 11:16 UTC

Price history

$0.00$0.63$1.25$1.88$2.50Dec 3Aug 13Sep 3Sep 24Oct 15Nov 5live pipeline →$1.99$1.00$0.75

Each point is the daily cross-provider median for this SKU and pricing type (per-provider medians first, so no marketplace’s volume dominates). Gaps are gaps — we don’t interpolate missing data.

Dashed/hollow points before 2026-08-09: archival reconstruction from dated provider pricing-page snapshots (see methodology) — fewer providers, monthly resolution.

At today’s median, one NVIDIA A100 40GB SXM works out to $6.38 per petaFLOP-hour (BF16, dense — 312 TFLOPS per the vendor datasheet, sparsity excluded). Price per unit of throughput is how generations actually compare — a cheaper card with fewer FLOPS can cost more per unit of work.

NVIDIA A100 40GB SXM, NVIDIA A100 80GB SXM, and NVIDIA A100 40GB PCIe are tracked as separate SKUs — different interconnect, different performance, different market. Comparing them in one number would be wrong, so we don’t.

Know what a GPU-hour costs before everyone else does.

One email a week: what moved, why, and where the spreads are. No sponsors choosing the content.

Free forever. Unsubscribe anytime.