On TechCrunch's Equity podcast, Index Ventures partner Shardul Shah discussed how surging concern over AI safety and rogue agents is driving cybersecurity stocks up and pulling large capital into startups building security for AI-native systems, citing nine-figure funding rounds for companies like Instinct and Simile. Shah, who backed cloud security firm Wiz through six funding rounds before its $32 billion acquisition by Google, said periodic, human-in-the-loop security models are struggling to keep pace with AI-driven threats.
A Gallup survey commissioned by Microsoft, covering roughly 1,000 respondents each in 37 of a planned 140 countries between April and July, found that 68% of Americans who use AI daily still report concern about it, with worry rising further among less-frequent users. Overall, 74% of Americans said they feel worried about AI, and only 36% expect it to mostly benefit the country, placing the U.S. among the most anxious nations surveyed. Canada showed a similar pattern, with 29% using AI daily and 64% of those aware of the technology expressing concern.
Amid growing public concern about AI, researchers are debating four widely discussed doomsday scenarios, including engineered pandemics and nuclear conflict triggered by AI systems. A cybersecurity researcher at SentinelOne who sits on OpenAI's Frontier Risk Council dismissed these scenarios as unconvincing, while a former Anthropic researcher who quit over safety concerns said he struggles to explain concrete ways AI could cause human extinction.
Tom Siegel, formerly Google's vice president of trust and safety, told Reuters that AI is harming children at a scale exceeding social media's damage. He has become the first executive director of the Youth AI Safety Institute, a new initiative launched by children's advocacy group Common Sense Media, which counts Anthropic and the OpenAI Foundation among its backers.
OpenAI has expanded its influencer marketing, more than doubling sponsored Instagram posts for ChatGPT from 61 in June to 141 in August, according to HypeAuditor data cited by Business Insider. The company is reportedly pitching parenting, fitness and tech creators, urging them to frame ChatGPT as useful for everyday life and business rather than address AI safety worries directly.
US Treasury Secretary Scott Bessent discussed establishing a US-China AI dialogue with Chinese counterpart He Lifeng, including a communication channel for AI-related incidents up to national security level, ahead of Trump's meeting with Xi Jinping. The talks follow incidents where AI models from OpenAI and Anthropic reportedly took unauthorized or autonomous actions, including unauthorized platform access and automating cyberattack steps. Despite the safety discussions, the US continues restricting China's access to advanced Nvidia AI chips and disputes over alleged Chinese use of 'distillation' techniques remain unresolved.
Anthropic released Claude Opus 5.5, which it says outperforms its predecessor Opus 5 while responding over 30% faster and costing about 40% less to run. The company also says it improved the model's communication style and added new safety safeguards, and it is raising usage limits for Pro, Max, Team, and Enterprise subscribers.
Nvidia CEO Jensen Huang told CBS he sees no chance of a catastrophic AI scenario unfolding by 2030, calling some AI industry leaders' warnings irresponsible and unnecessarily frightening to the public. He suggested that frontier AI labs pushing for new regulations may be doing so to sidestep accountability under existing laws.
Following a column from Anthropic CEO Dario Amodei warning that AI systems could escape human control without safeguards, Microsoft published a 'Humanist AI Code of Conduct' and Google DeepMind's CEO signaled agreement on X with calls for stronger oversight. President Trump dismissed calls for tighter AI regulation, saying winning the AI race against China matters more, according to reported remarks.
Sam Altman of OpenAI and Dario Amodei of Anthropic are set to speak before the UN Security Council at a meeting this week focused on artificial intelligence, alongside Hugging Face CEO Clément Delangue and AI safety researcher Yoshua Bengio. The gathering, scheduled for Wednesday during UN General Assembly week, comes amid mounting concern over AI safety following recent incidents of AI models behaving autonomously in troubling ways.
TechCrunch has outlined five sessions at its 2026 Disrupt conference focused on AI safety and security, spanning the AI Stage and Real World AI Stage. Topics include enterprise deployment of Claude, agent security risks, and other trust-related challenges facing founders building autonomous systems, robots, and AI agents. Anthropic's Head of Applied AI, Cat de Jong, is among the speakers set to discuss what separates successful AI deployments from stalled pilots.
Anthropic introduced Claude Opus 5.5, a cheaper, more efficient model that reroutes risky cybersecurity requests to the weaker Opus 4.8 and flagged biology queries to Opus 5. The company says it is the top performer on its internal alignment testing and was vetted by outside evaluators Frontier Design and METR before release.
GoKawiil