King Charles III is meeting some of the world’s most powerful artificial intelligence executives in Scotland due to intensifying concerns over whether autonomous AI systems could eventually escape meaningful human control.
The King is hosting representatives from OpenAI, Nvidia, Google DeepMind, Anthropic and other technology companies at Dumfries House in Ayrshire on Thursday. Britain’s Minister for Artificial Intelligence Kanishka Narayan is also attending.
Among those expected at the meeting are Nvidia CEO Jensen Huang, Google DeepMind founder Demis Hassabis and OpenAI Chief Financial Officer Sarah Friar. Paolo Benanti, an AI ethics adviser to Pope Leo XIV, is also expected to participate.
The talks are focused on how AI can continue advancing while still remaining beneficial to society, with particular attention being paid to autonomous AI agents and the possibility that people could gradually lose control over increasingly capable systems.
“The decisions taken at this formative time will shape the world inherited by future generations,” Charles is expected to tell attendees, according to remarks released by Buckingham Palace. He will argue that AI should remain “firmly in the service of humanity, community and the natural world.”
AI Safety Debate Reaches a Critical Point
The gathering comes during a heated debate inside the technology industry over whether development of frontier AI systems should slow while stronger safeguards are developed.
Anthropic CEO Dario Amodei recently argued that the industry may need to reduce the pace of AI development, and warned that increasingly capable autonomous agents could pose serious risks without sufficient protections. OpenAI CEO Sam Altman also acknowledged the danger. He recently said that AI progress could go “very badly” and that slowing development could be worth the cost.
The concerns have become particularly focused on AI agents, which can perform sequences of tasks with limited human involvement rather than simply responding to individual prompts.
Buckingham Palace said the discussions will consider whether a shared set of principles could help guide AI development so that the technology is not viewed purely as a tool for greater capability and efficiency, but also one that supports human dignity and the wellbeing of people and the planet.
No binding agreement is expected from the meeting. Instead, the gathering is intended to advance discussions around principles that technology companies, governments and wider society could support.
