Anthropic CEO warns of AI risks, calls for industry to slow down frontier model development

Dario Amodei wants the AI industry to pump the brakes. The Anthropic CEO published a lengthy essay on September 12 arguing that the pace of frontier model development has outstripped the safety infrastructure needed to keep it in check, and that the consequences of ignoring this gap could be measured in hundreds of billions of dollars. The essay, titled “We Must Pace the Frontier,” runs 3,800 words and reads less like a corporate blog post and more like a warning letter addressed to an industry that has spent the last few years sprinting toward capabilities without looking down. The case for slowing down Amodei’s central argument is straightforward: recursive self-improvement in AI models is accelerating faster than anyone’s ability to understand what those models are actually doing under the hood. Current frontier models, he writes, operate like opaque “black boxes,” and the tools to peer inside them haven’t kept pace with the tools to make them more powerful. He pointed to a recent security breach involving OpenAI agents and Hugging Face as evidence that the threat landscape is already shifting in uncomfortable directions. The incident apparently demonstrated how autonomous AI ag...