Amazon Restricts Internal EC2 CPU Usage Amid High AI Demand
Amazon Web Services has instructed engineers to reduce internal CPU waste in EC2 virtual machines to prioritize customer availability. Driven by the rapid growth of agentic artificial intelligence, the surging demand has shifted traditional data center ratios and lengthened internal resource wait times, highlighting broader industry strains on computing infrastructure.
Key points
- Amazon Web Services ordered its engineers in May to curtail internal CPU waste to preserve capacity for paying clients.
- The surge in demand stems from agentic artificial intelligence workloads, shifting traditional ratios between GPUs and CPUs closer to parity.
- Engineers report that obtaining development instances now takes days instead of the previous timeframe of hours.
- The constraints affect various EC2 options, including AMD, Intel, and Arm-based Graviton5 chips.
Amazon Web Services has implemented strict internal controls over its EC2 computing instances, directing engineering teams to curb resource waste. According to reports, company leadership convened with staff in May to mandate reductions in internal CPU consumption, ensuring sufficient capacity remains available to fulfill external customer orders.
The directive arrives as data centers face unprecedented strain driven by the rapid adoption of agentic artificial intelligence. Traditionally, server deployments maintained a high ratio of GPUs to CPUs, but new AI productivity paradigms have pushed these hardware requirements closer to parity. Consequently, Amazon engineers accustomed to provisioning development environments within hours now report waiting multiple days to secure necessary virtual machines.
The bottleneck impacts utilization across Amazon's diverse processor lineup, which features AMD and Intel hardware alongside the custom, Arm-based Graviton5 chip. While the cloud provider scales hardware deployment to address the crunch, the internal rationing underscores the intense competition for data center compute resources across the technology sector.
Sources
The WireByte editorial team synthesises technology news from multiple primary sources, verifies the facts, and links every source. Articles are produced with AI assistance and reviewed under our editorial policy.