Amazon instructs AWS engineers to cut CPU waste amid capacity crunch

Amazon Web Services, the cloud computing giant that powers a startling chunk of the internet, is doing something that sounds almost quaint for a trillion-dollar company: asking its engineers to turn off computers they’re not using. The directive targets idle EC2 instances, the virtual servers that form the backbone of AWS’s cloud infrastructure. With AI workloads devouring GPU capacity at an accelerating rate, even the world’s largest cloud provider is feeling the squeeze. The scale of the waste problem The numbers paint a picture of staggering inefficiency. Roughly 65% of EC2 instances maintain average CPU utilization below 20% over 30-day measurement windows. AWS’s Compute Optimizer tool has been upgraded to catch these ghost servers. It now analyzes CPU utilization and network I/O over 14-day lookback periods, flagging instances where peak CPU stays below 5% and network traffic is negligible. Amazon CEO Andy Jassy disclosed that AWS added over 3.8 gigawatts of power capacity in the previous year. For context, that’s enough electricity to power roughly 2.8 million homes. The company plans to double its capacity by 2027. AI demand is breaking the economics The capacity crunch has ...