Microsoft CEO Satya Nadella warns against trusting opaque AI to police AI

Microsoft CEO Satya Nadella has a message for companies racing to hand their operations to AI agents: do not let the robots grade their own homework. In a post on X on October 10, 2026, Nadella warned that advanced AI systems, particularly superintelligence models, should not be taken for granted. He argued that their behavior may be unpredictable, and that this could turn them into a new kind of insider risk. What Nadella is proposing The core of his argument is architectural. Nadella said every control governing an AI model should live outside the model itself. He tied that idea to the “reference-monitor principle,” a security concept dating back to the 1970s. Put simply, the guard should never live inside the building it is supposed to be guarding. His specific recommendations were practical rather than philosophical. He called for an emergency brake that lets humans step in while an AI system is running. He also pushed for strict logging of every action an AI takes. The reasoning behind both measures is a fear that models could become compromised. If a system goes off the rails, someone needs to be able to stop it. Afterward, someone needs a reliable record of what it actually ...