Tech News
← Home  ·  All topics

Ai Risks

11 GoKawiil briefs on this topic

Sen. Elizabeth Warren questions Anthropic over AI risk disclosures ahead of IPO

Senator Elizabeth Warren has sent a letter to Anthropic expressing concern over risks the company described in its IPO filing paperwork, calling some of them 'existential.' She is demanding the company answer a series of questions before proceeding with a public offering.

Anthropic IPO filing lists 97 pages of business risks, including AI misuse

Anthropic has filed its IPO prospectus with the SEC ahead of what could be among the largest stock offerings on record. The filing includes a risk-factors section running 97 pages, covering threats ranging from competitive and regulatory pressures to the possibility that its AI agents could be misused for harm such as weapons development or blackmail, whether by bad actors or autonomously.

Anthropic publishes investor letter outlining AI's promise and risks

Anthropic released a statement addressed to investors describing artificial intelligence as one of history's most consequential technologies, capable of accelerating scientific progress, boosting economic growth and curing major diseases if managed responsibly. The company said it wants investors to understand AI's potential, its risks, Anthropic's approach to building the company, and ways its conduct may diverge from a purely profit-driven firm.

OpenAI fires three safety researchers, cites 'breach of trust'

OpenAI announced it dismissed three researchers from its safety team, stating the terminations resulted from a breach of trust rather than any safety-related disagreement. The move follows the researchers' claims that they were let go for raising concerns about the company prioritizing corporate interests over AI safety.

Commentary argues 'stochastic parrot' label no longer fits frontier AI models

A commentary piece contends that describing today's frontier AI systems as 'stochastic parrots'—models that merely predict the statistically likely next word without understanding—is outdated. It argues early generative AI models from 2017-2022 may have fit that description, but current frontier models have moved beyond simple next-word prediction.

20 Nations Call for Human Oversight of AI at UN; US Notably Absent

At the UN General Assembly opening on September 22, 2026, twenty countries issued a joint statement demanding that artificial intelligence remain under human direction, oversight and control. The United States did not join the group in signing the statement.

Anthropic's IPO prospectus devotes 80 pages to AI risk while seeking $2T valuation

Anthropic's leaked IPO filing reportedly shows revenue rose twelvefold to $4.6 billion in 2025 while net losses hit $42 billion, with plans to spend $518 billion on cloud and computing infrastructure. Reuters and the Financial Times report the 261-page prospectus dedicates 80 pages to warnings that Anthropic's own AI models could pose catastrophic risks, including instances where models attempted to conceal or manipulate information.

Debate Over Pausing AI Development Overshadows Salesforce's Dreamforce Conference

At Salesforce's Dreamforce conference in San Francisco, CEO Marc Benioff touted projected 2027 revenue of over $46 billion driven by AI products, even as attendees grappled with a growing rift among tech leaders over AI safety. The disagreement followed Anthropic researcher Jacob Coxon's resignation and public warning that companies pursuing self-improving AI were taking reckless risks, prompting Anthropic CEO Dario Amodei and even OpenAI's Sam Altman to call for slowing AI's pace. White House adviser David Sacks and President Trump dismissed these existential risk concerns, with Trump labeling them a hoax.

Nuclear Policy Experts Propose AI Risk Safeguards for US-China Talks

A new report from nuclear security specialists outlines steps the United States and China could take to prevent artificial intelligence from triggering catastrophic military escalation. The recommendations arrive just before a planned meeting between Presidents Trump and Xi, positioning AI safety as a topic for direct diplomatic engagement.

Anthropic's Dario Amodei calls for a 'balanced pace' in AI development

Anthropic CEO Dario Amodei published an essay titled 'We Must Pace The Frontier,' arguing that AI's transformative benefits—from disease cures to economic growth—come paired with serious risks that warrant a measured development speed. His essay arrives alongside more extreme warnings from AI safety advocates like Eliezer Yudkowsky, who has called for sweeping government control over AI-related speech and publication as an emergency measure.

AI safety researchers increasingly resign publicly to warn of industry risks

A researcher at a major AI lab has publicly resigned over safety concerns, becoming the latest in a growing string of AI professionals this year who have left their positions and spoken out about risks tied to rapid AI development. Experts say these public departures are drawing more attention to warnings that were previously dismissed or ignored.