Amid growing concerns over the safety of AI technology across various sectors, OpenAI has announced the appointment of Christiano to its non-profit foundation board and safety committee. Christiano warns that without effective coordination mechanisms in building superintelligence, humanity will permanently lose control over it, potentially leading to the deaths of most people. Given the current state of AI capability development and the difficulty of coordination, he believes there is a catastrophic and irreversible risk of losing control due to rapid AI advancement in the short term. The AI industry, including OpenAI, has not yet found an effective path to reduce this risk to an acceptable level.
