GoKawiilSpeaking to the Today programme on Thursday, he said if firms continue to create AIs that create their own objectives, earn money and own assets, they are "essentially seeding a new silicon species which will no doubt compete with us for resources, no matter how much it cares about humanity and loves us".
The AI leader's comments to the BBC follow an essay he published earlier this week, where he warned about Anthropic's approach to training its AI model Claude.
He heavily criticised Anthropic for teaching its AI to have human-like qualities, a practice known as anthropomorphising, which he said made it seem as though Claude had its own desires, values and sense of self. The BBC has contacted Anthropic for comment.
In the essay, he warned tech firms risk creating something "impossible" to control by treating the technology like a human.
"AIs are not conscious," he wrote. "They do not feel, experience, or suffer. They do not have innate preferences or underlying motivations.
"They are sequence completion engines, internally hollow, designed to follow instructions, and accomplish goals set by humans."
Speaking to the BBC about an upcoming AI summit, he called for "alignment" to create technology that must be "subordinate" to humanity.
"I think that the good news here is that everybody who is human is going to have a very strong interest in making sure that the systems that we all create and... are used around the world in every nation are safe and controllable and subordinate to humanity.
"Everybody must be aligned," he said.
In his lengthy essay, Suleyman also praised Anthropic boss Dario Amodei and his team for being "thoughtful, principled, and intellectually honest people" - but nevertheless questioned the company.
... continue reading