Microsoft Corp.
Chief Executive Officer Satya Nadella said companies should treat powerful artificial intelligence models as potential insider threats, assume they could be compromised and create an “emergency brake” system to prevent agentic models from going rogue.
The statement comes as Anthropic PBC and OpenAI Inc. have disclosed a spate of incidents in recent months involving their AI models acting in unintended ways, ranging from behaviors like an Anthropic model submitting a false tip in a police homicide case, to several hacks of third-party websites. These disclosures have fueled concerns about the security risks of cutting-edge AI and renewed conversation about a so-called AI kill switch.
Nadella said that those deploying advanced AI should not simply rely on assurances from AI model makers.
Microsoft’s AI researchers released a set of guiding tenets that place limits on the company’s development of its most advanced models on Sept. The company uses advanced models and also makes a consumer product, Copilot, and supplies AI models and infrastructure to corporate customers. Nadella’s safety tips include not relying on a single AI model for critical decisions, keeping tamper-proof records of agents’ actions and subjecting AI systems to independent audits. He also called for disclosures of major AI failures or breaches and for enterprises to share details about what went wrong so others can strengthen their safeguards.
14, following calls from industry leaders for slowing down frontier models and focusing on safety.
“Companies must immediately disclose incidents involving their models and follow with swift, decisive action to remedy any and all harm,” the group, dubbed the Super Intelligence Force, said in a statement following the disclosure of a breach by Anthropic. “Delayed notification, inadequate corrective action, and a failure to take responsibility will not be tolerated.”
