UN calls for 'urgent action' to rein in AI in face of 'unprecedented risks'

In a letter sent to countries and AI developers and shared with the media, Volker Turk cautioned that the world was "on the cusp of irreversible change, affecting not just us but generations of humanity to come".

"The current race towards ever more powerful AI is a step change towards greater existential risks to every aspect of our lives."

He sent the letter at a time when worries over the risks of "superintelligent" computer systems have been on full display, after a researcher publicly resigned from leading AI firm Anthropic over fears that the technology could escape human control.

Another Anthropic employee, who did not resign, stated publicly that "we really do earnestly believe AI could kill all humans", and that he thought the chances were greater than "10 percent within the next decade".

Amid the outcry, Anthropic CEO Dario Amodei called Saturday for AI companies to "pace the frontier" -- or coordinate a slowdown in the technology's development, with his chief competitors, xAI's Elon Musk and OpenAI's Sam Altman, publicly supporting him.

"In today's world, we are almost entirely reliant on a small number of powerful companies to make the right choices on Al development for all of humanity," Turk lamented.

"I call on States and companies to mobilise urgently through multilateral fora to chart a path for action to govern advanced, frontier AI models, grounded in international human rights law."