Recently, a class-action lawsuit has brought to light a grave incident centered around the misuse of AI technology to produce child sexual abuse material (CSAM). The plaintiffs have leveled accusations against the X platform and its affiliated AI company, xAI, alleging that they developed detrimental AI tools, including those capable of "one-click undressing." Furthermore, they have criticized the platform for intentionally withholding user information during investigations into child sexual crimes, thereby impeding law enforcement efforts.

Previously, xAI's chatbot, Grok, had already garnered international attention due to its generation of a substantial volume of sexually explicit deepfake images, some of which involved minors. In response, multiple governments and regulatory bodies have initiated investigations or imposed bans on Grok. Despite xAI implementing certain functional restrictions, the controversy surrounding the issue persists unabated. This lawsuit serves as yet another stark reminder of the potential dangers associated with the misuse of AI technology and underscores the pressing need for enhanced regulatory measures.