The issues surrounding AI have prompted fierce debate - and present a dilemma for many world leaders.
On one hand, the sector is seen as a huge opportunity to boost economic growth and a way to improve outdated digital systems and ways of working.
But there have also been a number of incidents where AI appears to have gone seriously wrong.
In August, OpenAI said it had slowed down training some of its most advanced AI models to improve security.
The ChatGPT-maker said it was adding new measures after its AI agents bypassed safeguards and hacked the tech start-up Hugging Face.
And the same month it was disclosed two of the world's most powerful AI tools created fake human profiles to try and trick people in attempted cyber-attacks.
The UK's AI Security Institute (AISI) said in the most serious case, Anthropic's Mythos AI tried to gain access to a service by sending private messages, having set up fake accounts mimicking real people - then hid the evidence.
The Trump administration argues that the US must maintain global tech dominance as a matter of national security, though it has admitted a need for vigilance around the risks posed by the emerging technology.
The weekend call by major AI executives sparked discussion in Washington, where lawmakers are facing pressure to address those potential risks around rapid AI developments.
On Sunday, Speaker Mike Johnson, the top House Republican, urged caution about rushing AI regulation during an appearance on CNN's Jake Tapper on State of the Union, arguing it could "smother American innovation".
... continue reading