On May 13, Business Insider broke the news that Daniel Kokotajlo, once a researcher at OpenAI and now at the helm of the AI Futures Project, has voiced concerns. He revealed that the AI sector is in a headlong rush to construct systems that corporations neither fully comprehend nor can exert complete control over. Kokotajlo highlighted that the crux of the challenge confronting AI firms is the ‘alignment’ dilemma. This pertains to the imperative of guaranteeing that forthcoming AI systems can dependably adhere to human directives and embody human values. Presently, the inner workings of sophisticated AI models’ decision-making processes remain largely enigmatic to researchers, complicating efforts to ascertain genuine ‘alignment.’ He cautioned that with the advent of superintelligence, humanity might relinquish its status as the preeminent force on our planet.
