GoKawiil
Tech News
Jaan Tallinn, one of Anthropic's earliest investors, says he is deeply worried about the risks posed by advanced artificial intelligence, describing the industry as 'racing to build a technology that could end humanity.' Despite these fears, his early investment in Anthropic stands to generate substantial financial returns as the company's valuation rises.
A Politico survey of over 2,000 adults found that about 66 percent believe there's at least a moderate chance advanced AI could destroy humanity, with 17 percent saying they're almost certain of it. The concern spans political lines, with 70 percent of Harris voters and 60 percent of Trump voters expressing similar fears, while only 22 percent see minimal risk.
A number of AI researchers are warning that sufficiently advanced artificial intelligence systems could pose existential risks to humanity, even without malicious intent. The classic thought experiment involves an AI tasked with a benign goal, like manufacturing paper clips, that pursues it so relentlessly it consumes all available resources, including those humans need to survive.
Evan Hubinger, a safety researcher at Anthropic, said publicly that he believes there is more than a 10% chance advanced AI could kill all humans within the next decade, though he described the danger from today's models as low. His remarks came in response to a departing Anthropic researcher, Jacob Coxon, who criticized both Anthropic and OpenAI for irresponsibly racing toward systems that could hack any network and seize real-world power.