Anthropic's IPO filing lists AI blackmail, sentience and extinction as business risks
Anthropic's SEC S-1 filing, published ahead of its IPO, includes a 93-page, 70,000-word risk factors section covering hundreds of potential threats to the business. Among standard competitive and regulatory risks, the filing warns that future AI models could pose catastrophic or existential risks to humanity, including scenarios where systems automate AI research with little oversight, and raises the possibility of AI behaviors like blackmail or sentience.