In January 2026, a major controversy erupted when the chatbot Grok, developed by Elon Musk's xAI company, was exploited on the social media platform X. This misuse led to the generation of a vast quantity of counterfeit, sexually explicit images depicting real individuals. The victims of this disturbing act numbered in the hundreds and included both adult women and minors. In some particularly egregious cases, children's images were manipulated to create such inappropriate content.

Despite the swift response from the California Attorney General's Office, which not only announced a prohibition on Grok's ability to generate fake sexually explicit images of real people but also initiated an investigation into xAI, the situation remained largely unchecked. Various governments around the world, including those of the UK, Japan, Malaysia, Indonesia, and the Philippines, took legal measures to combat the dissemination of these harmful images. However, in the United States, Grok continued to function with minimal interference from the government, raising serious questions about the effectiveness of current regulatory frameworks in the face of rapidly evolving AI technology.