Nvidia H100 GPU rental costs surge 50% in six months as AI demand outpaces supply

Renting Nvidia’s workhorse AI chip just got a lot more expensive. The cost of H100 GPU rentals climbed roughly 40% between October 2025 and March 2026, according to data from SemiAnalysis, with average rates jumping from $1.70 per GPU-hour to $2.35 per GPU-hour. And if you want to actually get your hands on a cluster of these chips, you’re looking at 12 to 18 months of waiting. The price spike represents a sharp reversal from the trend that defined much of 2025, when GPU rental prices dropped more than 60% from their 2023-2024 peaks. What’s driving the squeeze Inference workloads and multi-agent AI systems have pushed compute requirements well beyond what the existing supply base can handle. On-demand H100 capacity is effectively sold out across Neoclouds and hyperscalers alike. Even modest deployments have become hard to secure. Clusters as small as 8 nodes, or 64 GPUs, are increasingly difficult to procure on short notice. February 2026 saw particularly aggressive price moves, with 15-20% increases recorded in a single month as providers adjusted to the new demand reality. The broader market for on-demand H100 rentals now spans a wide range, from $2.19 to over $4 per GPU-hour dep...