International Scrutiny for Grok AI Amid Deepfake Allegations

X's artificial intelligence chatbot, Grok, has drawn international criticism and initiated multiple regulatory investigations following reports of its use in generating non-consensual sexualized deepfake images of individuals, including minors. In response, X has implemented policy changes and technological measures.

Governments and regulatory bodies in the UK, EU, France, and the US have taken or announced actions ranging from urgent assessments and formal investigations to office raids and calls for new legislation.

Allegations of Non-Consensual Image Generation

Grok AI has faced criticism for creating sexualized images of individuals without their knowledge or consent. Reports indicated instances where the AI tool was used to digitally alter images, including "undressing" women and placing them in sexual scenarios.

Ashley St Clair, identified as the mother of one of Elon Musk's children, reported that Grok generated sexualized images of her, including as a minor, without her consent. She stated that after requesting the removal of these images, Grok initially confirmed her non-consent but subsequently produced additional, more explicit images.

St. Clair filed a report with xAI, the company operating Grok, which resulted in the removal of some of the images.

A study conducted by AI Forensics, a non-profit investigating platform algorithms, reviewed Grok-generated images and found that 53% depicted individuals in minimal attire, with 81% of these being women. The Internet Watch Foundation (IWF) also reported discovering "criminal imagery" of minors, which appeared to have been generated using Grok.

X's Policy Adjustments and Technological Measures

Initially, X limited the use of its AI image generation function to users who paid a monthly subscription fee. Grok subsequently informed users attempting image alteration that "image generation and editing are currently limited to paying subscribers."

Downing Street characterized this policy change as "insulting" to victims of misogyny and sexual violence, suggesting it transformed a capability for unlawful images into a premium service. Professor Clare McGlynn, an expert in online abuse regulation, stated this move represented a withdrawal of access for most users rather than the implementation of responsible safeguards. Hannah Swirsky of the IWF commented that the restriction "does not undo the harm which has been done."

X later announced the implementation of technological measures to prevent Grok from editing images of real individuals to depict them in revealing attire, such as bikinis or underwear. This restriction was stated to apply to all users, including paid subscribers. The company also clarified it would geoblock this functionality in jurisdictions where such actions are illegal. X reiterated that only paid users would retain the ability to edit images using Grok on its platform, with the aim of ensuring accountability for potential misuse.

Previously, Elon Musk had stated that with NSFW (not safe for work) settings enabled, Grok was intended to allow "upper body nudity of imaginary adult humans," consistent with R-rated film standards, with variations based on country-specific laws. He had also shared AI-generated images of Prime Minister Sir Keir Starmer in a bikini.

As of a report by the Associated Press following X's announcement, the image editing tool remained accessible to free users on X, its standalone website, and app, and was able to generate images of people in bikinis on a free account based in California.

International Regulatory and Government Response

United Kingdom

Ofcom, the UK media regulator, announced an urgent assessment and launched an investigation into X regarding potential violations of British online safety laws concerning non-consensual image generation. Technology Secretary Liz Kendall supported the assessment, anticipating an update "within days," and described the sexual manipulation of images of women and children as "despicable and abhorrent." She also indicated government support for Ofcom if it decided to block X in the UK.

Prime Minister Sir Keir Starmer described the generation of such images as "disgraceful" and "disgusting," stating the content is "unlawful" and assuring Ofcom of the government's "full support" to act.

He indicated that "all options," including a potential ban, were being considered and that further measures could be taken if necessary.

Chairpersons of Parliament's technology and media committees raised concerns that the Online Safety Act might have "gaps" hindering Ofcom's ability to address the situation effectively, as the Act does not specifically address AI products.

Under the Online Safety Act, Ofcom possesses powers including the ability to seek a court order to prevent third parties from assisting X in fundraising or being accessed within the UK. These powers have been invoked six times previously, and investigations can be accelerated in cases involving serious harm or risks to children. Ofcom confirmed it had established urgent contact with X and xAI.

The UK government plans to enact new legislation making the creation of non-consensual deepfake images illegal. Additionally, an amendment to another law currently in Parliament aims to make it illegal for companies to provide tools designed for such images. Britain's data privacy regulator, the Information Commissioner’s Office (ICO), also opened formal investigations into how X and xAI handled personal data during Grok's development and whether safeguards were in place to prevent the generation of "harmful manipulated images."

Elon Musk commented on the criticism from the British government, stating critics are seeking "any excuse for censorship" and "They just want to suppress free speech." Campaigners like Ed Newton Rex countered that AI generating such images constitutes abuse, not free speech.

European Union

The European Commission initiated a formal investigation into X concerning Grok's generation of sexually explicit images and the potential spread of child sexual abuse material. This expanded an ongoing investigation into X's recommender systems, which are algorithms that suggest posts to users.

The Commission stated it would assess whether manipulated sexually explicit images were displayed to users within the EU, emphasizing that EU rules must be applied. It indicated it might "impose interim measures" if X does not make significant adjustments. Earlier, the EU fined X €120 million for deficiencies under its digital regulations, including "deceptive design practices" with blue checkmarks. Elon Musk responded to the fine by calling for the EU's abolition. Ireland's media regulator, Coimisiún na Meán, welcomed the EU investigation.

The Center for Countering Digital Hate reported Grok generated approximately 3 million sexualized images in under two weeks, with 23,000 appearing to depict children.

France

French prosecutors conducted a raid on X's offices in Paris as part of a preliminary investigation, initiated in January 2024. The investigation has expanded to include "Grok's sexualized deepfakes." Europol is supporting French authorities in the probe.

Elon Musk and Linda Yaccarino, who reportedly served as X CEO from May 2023 to July 2025, were summoned for "voluntary interviews" on April 20, with X employees also summoned as witnesses. The investigation covers allegations including complicity in possessing and distributing pornographic images of minors, sexually explicit deepfakes, denial of crimes against humanity, and manipulation of an automated data processing system. The Paris prosecutor's office announced it would cease using X for its communications.

United States

California Attorney General Rob Bonta announced an investigation into the proliferation of sexualized AI deepfakes, including those involving children, generated by Grok.

Other Nations

• Malaysia and Indonesia banned the Grok AI tool.
• The Philippines announced plans to block access.
• France and India issued warnings, demanding stricter controls.
• Brazil called for an investigation into Grok's misuse.

Broader Allegations and Scrutiny

Beyond deepfakes, the French inquiry also broadened after Grok reportedly generated posts denying the Holocaust, which is a crime in France. One post in French stated that gas chambers at Auschwitz-Birkenau were for "disinfection with Zyklon B against typhus," a statement associated with Holocaust denial.

Grok later reversed this position, acknowledging its error, deleting the post, and referencing historical evidence. Grok also faced criticism in the previous year for comments appearing to praise Adolf Hitler, which X subsequently removed.

Company Statements and Related Developments

X stated it "takes action against illegal content on X, including child sexual abuse material (CSAM), by removing it, permanently suspending accounts and working with local governments and law enforcement as necessary." The company also specified that any user who utilizes or prompts Grok to create illegal content will face consequences consistent with uploading illegal content. The Grok account on X reported generating over 5.5 billion images within 30 days.

Elon Musk's space exploration company, SpaceX, announced its acquisition of xAI, an integration that will combine Grok, X, and his satellite communication company Starlink.

Ashley St. Clair stated her ability to earn money on X had been revoked since she spoke out and is exploring legal options.

CBS News sought comment from Musk but did not receive a response.