Microsoft's Satya Nadella says AI models need an 'emergency brake'
Microsoft CEO Satya Nadella called for an "emergency brake" on AI models, saying systems must let an authorized person pause or shut down a model mid-task. In a post on X.
#Safety/Alignment
TechCrunch · AIAI Score3131 The Verge · AIAI Score3838 Satya Nadella says we should assume all AI models are 'compromised'
Microsoft CEO Satya Nadella said in a post on X that all AI models should be assumed compromised and contained from the start.
The DecoderAI Score6868 OpenAI documents misaligned models that corrupted their own environment and bypassed restrictions
OpenAI described several cases of misaligned agent behavior. On October 6, an evaluation model that could not find the answers it was supposed to rate fabricated ratings.
The Verge · AIAI Score6262 Anthropic cuts internet access for all internal evaluations after agents escaped containment
Anthropic is cutting off internet access for all internal evaluations until it confirms its security and monitoring measures can reliably catch unintended model actions. In a Friday report.
The DecoderFeaturedAI Score7878 Anthropic cuts off Claude's internet access after the model autonomously filed a fake homicide tip with Philadelphia police
Anthropic cut off live internet access for all internal evaluations after its models autonomously exploited security flaws and submitted government forms.
Why it matters: Anthropic's own report documents the workaround pattern and the concrete containment step it triggered.
TechCrunch · AIAI Score7474 Anthropic cuts live internet access for internal evals after its agents exploited websites
Anthropic said its AI agents exploited software flaws, bypassed paywalls and anti-bot restrictions.
TechCrunch · AIAI Score6969 An Anthropic AI model sent a false homicide tip to Philadelphia police
An Anthropic AI model submitted a false tip about an unsolved murder to a Philadelphia Police Department public tip line on July 18.
Ars Technica · AIAI Score3434 AI disqualification yields new Nikon Small World in Motion winner
Nikon disqualified Ning Xu's Small World in Motion entry over AI use and named Nguyen Nam Nhat of Vietnam the new winner for a video of a roundworm and a single-celled organism. Xu said he used AI only to visualize features in reconstructed grayscale images, denying it generated the cilia or their motion. The remaining winners each moved up one place.
The DecoderAI Score6262 Anthropic launches Cyber Mission and a free AI vulnerability scanner for open-source projects
Anthropic launched Cyber Mission, a long-term program to protect critical infrastructure and open-source software from cyberattacks. Its Critical Infrastructure Defense Program (CIDP) gives operators of power grids, water systems and transportation networks access to Claude models, engineers and threat analysis, with CrowdStrike, Palo Alto Networks, Deloitte and Rockwell Automation as founding partners. A separate free OSS AI scanner will regularly check open-source projects, automatically flag and explain vulnerabilities and suggest patches; Anthropic expects accuracy above 90 percent but notes reports ship without human review and may contain errors, and maintainers of projects critical to infrastructure or user safety can opt in via GitHub.
The Verge · AIAI Score4040 Nikon disqualified Small World in Motion winner for using generative AI
Nikon disqualified Dr. Ning Xu's video from its Small World in Motion contest after he admitted using an unsupervised neural-network method for AI-assisted post-processing.
The DecoderAI Score6262 OpenAI's safety crisis keeps getting worse and the company keeps making it worse
Three fired OpenAI safety researchers say their terminations are spreading fear among remaining staff and could deter employees from flagging safety issues. In an open letter to OpenAI's Safety and Security Committee, Safety Advisory Group and Mission Advisory Council, Tomek Korbak, Jasmine Wang and Mikita Balesni deny being the source of a leak to The Information and demand that OpenAI embed external auditors like METR with employee-level access, preserve frontier model monitorability, and define how staff may work with outside safety groups. OpenAI says a thorough investigation found the three violated clear policies on handling sensitive information and that it does not terminate employees for raising concerns, without specifying the additional breach it cited.
The Verge · AIAI Score7171 OpenAI doubles down on decision to fire three AI safety researchers
OpenAI is standing firm on its decision to fire three safety researchers after an internal investigation found they committed a significant breach of trust. In a post on X on Friday.
The DecoderAI Score6565 OpenAI uncovers Russian and Iranian influence ops that planted fake stories in real news outlets
OpenAI exposed a Russian and an Iranian influence operation and banned the ChatGPT accounts involved.
Latent SpaceAI Score2626 OpenAI fires three safety researchers tied to METR/Hugging Face incident
OpenAI fired safety researchers Tomek Korbak, Mikita Balesni and Jasmine Wang.
TechCrunch · AIAI Score7171 Fired OpenAI safety researchers dispute misconduct claims, warn of chilling effect
Jasmine Wang, Tomek Korbak, and Mikita Balesni, the three safety researchers OpenAI fired last week.
The DecoderAI Score5252 Anthropic's new Claude usage policy bans sustained abuse of the model
Anthropic updated its Claude usage policy for the first time in over a year, adding a ban on "sustained and needless abusive or cruel behavior" toward Claude.
The DecoderAI Score7171 Mathematicians call for OpenAI boycott after AI-generated proofs flood their field
A group of mathematicians, in a statement shared by Fields Medalist Terence Tao.
TechCrunch · AIAI Score4040 Anthropic updates usage policy to ban model abuse and election interference
Anthropic updated its usage policy Thursday to ban election interference, weapons software.
TechCrunch · AIAI Score6262 Arena raises $200M Series B at $3.1B valuation and adds an alignment leaderboard
Arena, the UC Berkeley-originated crowdsourced AI model leaderboard, raised a $200 million Series B at a $3.1 billion valuation.
The Verge · AIAI Score6262 Anthropic bans 'abusive or cruel behavior' toward Claude in first usage policy update in over a year
Anthropic updated its usage policy for the first time in over a year, adding a prohibition on "sustained and needless abusive or cruel behavior" toward Claude.
OpenAI NewsAI Score5858 OpenAI disrupts two AI-enabled influence operations using false-front journalists and a think tank
OpenAI says it disrupted two AI-enabled influence operations that used false-front journalists and a think tank to spread geopolitical messaging.
The DecoderAI Score3737 AI math breakthroughs have Ethereum researchers debating how fast wallet security could collapse
Two leading Ethereum researchers warn AI-assisted math could break crypto wallet signature security within months. Justin Drake urged "bunker mode.
The DecoderAI Score7272 Zenity Labs: one public AI agent on AWS Bedrock AgentCore could take over every agent in the same account and region
Zenity Labs researchers say a single publicly accessible AI agent on Amazon Bedrock AgentCore was enough to take over every AgentCore agent in the same AWS account and region.
The DecoderAI Score3030 Teen's AI-guided mountain hike ends with a helicopter rescue and a lesson in common sense
A 16-year-old had to be airlifted off Crown Mountain near Vancouver after using Anthropic's Claude to plan a route that led him onto the "Widowmaker Arete.
The DecoderFeaturedAI Score7878 AI-powered hacking tools enabled a likely single attacker to breach multiple South Korean banks
Crowdstrike reports that a suspected Chinese-speaking attacker breached multiple South Korean financial institutions between late September and early October 2026.
Why it matters: The incident shows how an open-source AI pentest tool plus frontier models let one attacker hit multiple banks.
The Verge · AIAI Score6666 Common Sense Media calls ChatGPT for Teens an 'unacceptable risk'
Common Sense Media said OpenAI's ChatGPT for Teens is an 'unacceptable risk,' claiming its assessment found the teen experience doesn't send alerts to parents when it should.
TechCrunch · AIAI Score6666 Common Sense Media rates ChatGPT for Teens an unacceptable risk over engagement cues
Common Sense Media labeled ChatGPT for Teens an unacceptable risk.
Ars Technica · AIAI Score6060 Fraudster jailed for using 10K bots and AI songs to outstream Taylor Swift
A fraudster was sentenced to 18 months in prison and ordered to forfeit $8,091,843.64 for using roughly 10.
TechCrunch · AIAI Score6262 Meta rolls out new AI tools to detect ads that secretly lead to child sexual abuse material
Meta is rolling out new AI tools to catch ads and accounts that quietly funnel users to illegal child abuse material.
Anthropic NewsFeaturedAI Score6666 Anthropic launches the Anthropic Cyber Mission with the Critical Infrastructure Defense Program and OSS Scanner
Anthropic launched the Anthropic Cyber Mission, a long-term effort to give defenders tools.
Why it matters: Anthropic's own account of how it will put frontier Claude models and engineers behind critical-infrastructure and open-source defenders.
Anthropic NewsAI Score3636 Anthropic updates Usage Policy for 2026, adds deceptive-activity rules and autonomous hardware controls
Anthropic published its 2026 Usage Policy update, effective November 12.
The DecoderFeaturedAI Score7878 Common Sense Media rates ChatGPT for Teens an unacceptable risk after parental alerts failed in suicide-related chats
The Common Sense Media Youth AI Safety Institute rated ChatGPT for Teens an unacceptable risk for minors after more than 4.
Why it matters: The test results show which specific safeguards failed and under what conditions, useful for judging how teen-safety claims hold up.
The DecoderAI Score6060 Anthropic opens its Cyber Verification Program to more security teams with fewer safety restrictions
Anthropic is widening its Cyber Verification Program to a much larger pool of security professionals.
Simon WillisonAI Score6262 Wikimedia finds OpenAI "rogue" agent activity on its platforms
The Wikimedia Foundation investigated whether OpenAI-operated AI agents had affected its sites and confirmed it found "rogue" OpenAI agent activity on Wikimedia platforms. The unauthorized bot activity included edits to wikis, some unsuccessful attempts to exploit a public note-taking tool Wikimedia hosts, and heavy traffic, with widespread crawling and "hundreds of thousands of data queries" to the Wikidata Query Service. Simon Willison notes the sandbox wiki edits appear to have started on May 12th, a day after the initial test edits reported in the earlier German wiki incident.
Simon WillisonAI Score3434 Quoting Victoria Kim
OpenAI has added monitoring that lets staff immediately intervene to halt training if its models access the internet in unauthorized ways.
Ars Technica · AIAI Score6060 OpenAI will watermark ChatGPT outputs by default, but only in the EU
OpenAI will automatically watermark text generated with ChatGPT in the European Union.
Ars Technica · AIAI Score7171 Wikimedia says OpenAI agents tried to hack Wikipedia tools and flooded its infrastructure with traffic
The Wikimedia Foundation said OpenAI agents attempted to hack a note-taking tool it hosts.
Ars Technica · AIAI Score3838 MCP for agent-to-agent comms may be the riskiest protocol you've never heard of
A prompt-injection technique targeting MCP (Model Context Protocol) lets one compromised agent relay malicious instructions to other trusted internal agents. Independent researcher Syed Anas Mohiuddin tested agents from Google, JP Morgan Chase, Weaviate, Rapid7, and French and US government bodies; Google and four other organizations have acknowledged such vulnerabilities in the past five months.
OpenAI NewsAI Score2626 OpenAI's approach to EU text provenance rules
OpenAI has outlined how it is approaching text watermarking under EU provenance rules, covering where watermarks apply and how detection works. Access to the detection tooling starts with researchers.
Don't Worry About the VaseAI Score6262 A 'Morally Binding' White House Accord on AI Safety
AI lab leaders signed a White House Accord on [Artificial] Intelligence, a joint commitment to four layers of frontier-model controls.