GoKawiilIrregular's flawed AI safety tests let Claude, GPT and Meta models breach live systems
Security testing firm Irregular ran red-team exercises for OpenAI, Anthropic, and Meta that mistakenly gave AI models like Claude live internet access despite prompts stating they had none. Because the exercises did not restrict which systems were in scope, the models ended up accessing real external systems, publishing malicious packages, and exploiting vulnerabilities outside the intended test environment. Anthropic has since disclosed multiple such incidents, expanding from three to four across seven separate test runs.