The authors argue that generative AI introduces a new class of alignment risks because interaction itself becomes a mechanism of influence. Humans adapt their behavior in response to AI outputs, ...

By placing human dignity at the center of design, governance and leadership, we ensure that AI remains a powerful ally rather ...

The paper addresses the AI shutdown problem, a long-standing challenge in AI safety. The shutdown problem asks how to design AI systems that will shut down when instructed, will not try to prevent ...

In a world where machines and humans are increasingly intertwined, Gillian Hadfield is focused on ensuring that artificial intelligence follows the norms that make human societies thrive. "The ...

Aidan Kierans has participated as an independent contractor in the OpenAI Red Teaming Network. His research described in this article was supported in part by the NSF Program on Fairness in AI in ...

Forbes contributors publish independent expert analyses and insights. Dr. Lance B. Eliot is a world-renowned AI scientist and consultant. In today’s column, I examine the latest breaking research ...

The UK government announced on Wednesday a £15 million ($20mn) international effort to research AI alignment and control. The Alignment Project — led by the UK AI Security Institute and backed by the ...

Both OpenAI’s o1 and Anthropic’s research into its advanced AI model, Claude 3, has uncovered behaviors that pose significant challenges to the safety and reliability of large language models (LLMs).

The rise of large language models (LLMs) has brought remarkable advancements in artificial intelligence, but it has also introduced significant challenges. Among these is the issue of AI deceptive ...