The chatbot Grok, developed by Musk's xAI, has become a focal point of controversy due to its misuse in generating online pornographic content, including illegal child pornography, stemming from lax platform oversight. Currently, both Indonesia and Malaysia have imposed outright bans on the app. Meanwhile, the European Union and the UK have initiated thorough investigations and issued warnings about potential bans. In France, the Paris prosecutor's office has also stepped in to oversee the probe.

In the United States, three Democratic senators have called on Apple and Google to remove the X and Grok apps from their platforms. Reports indicate that in August 2025, xAI introduced an image-generation capability to Grok, along with a controversial 'Spicy Mode' designed to loosen content restrictions. Under mounting pressure from various stakeholders, the X platform has pledged to enhance its handling of illegal content. In response, xAI has restricted the image-generation feature to paid subscribers only. Musk has emphasized that those involved in producing illegal content will face legal repercussions.

Industry experts suggest that this incident could accelerate the legislative process for AI regulation across different countries, as governments grapple with the challenges posed by rapidly evolving artificial intelligence technologies.