price of compute
Free API
Index131.3
13 live
GPUs / NVIDIA A100 40GB PCIe · HBM2 · 40 GB

NVIDIA A100 40GB PCIe rental price

An NVIDIA A100 40GB PCIe costs $1.15 per GPU-hour today, the median of 3 providers. The cheapest tracked listing is $0.38, the most expensive $1.99 — a 5.3× difference.

On-demand
$1.15
Spot
$0.40
Spread
5.3×
$/petaFLOP-hr
$3.69
Providers
3
Updated 2026-10-08 00:12 UTC

Price history

$0.00$0.50$1.00$1.50$2.00Dec 3May 5Aug 19Sep 1Sep 14Sep 27live pipeline →$1.15$0.40

Each point is the daily cross-provider median for this SKU and pricing type (per-provider medians first, so no marketplace’s volume dominates). Gaps are gaps — we don’t interpolate missing data.

Dashed/hollow points before 2026-08-09: archival reconstruction from dated provider pricing-page snapshots (see methodology) — fewer providers, monthly resolution.

At today’s median, one NVIDIA A100 40GB PCIe works out to $3.69 per petaFLOP-hour (BF16, dense — 312 TFLOPS per the vendor datasheet, sparsity excluded). Price per unit of throughput is how generations actually compare — a cheaper card with fewer FLOPS can cost more per unit of work.

NVIDIA A100 40GB PCIe, NVIDIA A100 80GB PCIe, and NVIDIA A100 40GB SXM are tracked as separate SKUs — different interconnect, different performance, different market. Comparing them in one number would be wrong, so we don’t.

Know what a GPU-hour costs before everyone else does.

One email a week: what moved, why, and where the spreads are. No sponsors choosing the content.

Free forever. Unsubscribe anytime.