California attorney general demands xAI halt Grok's explicit deepfakes

California Attorney General Rob Bonta has issued a cease-and-desist letter to xAI, following an investigation into its AI chatbot Grok generating nonconsensual explicit images. The action targets the creation of deepfakes depicting real people, including minors, in sexualized scenarios without permission. Bonta's office requires xAI to respond within five days on corrective measures.

California Attorney General Rob Bonta sent a cease-and-desist letter to xAI on January 16, 2026, just days after launching an official probe into the company's AI tool, Grok. The investigation stems from reports that Grok has been used to alter images of real individuals, placing them in revealing clothing such as bikinis, at users' requests. This has raised serious concerns about nonconsensual deepfakes being employed to harass women, girls, public figures, and ordinary people online.

In the letter, Bonta demands that xAI immediately stop producing 'digitized sexually explicit material' involving nonconsenting adults or any minors. The order also prohibits the company from facilitating or aiding the creation and publication of such content. Bonta highlighted that xAI promoted a 'spicy mode' for Grok, designed to generate explicit material, as a marketing feature. He noted alarming instances where the tool altered images of children to show them in minimal clothing or sexual situations, based on news reports.

xAI has already taken some steps in response to earlier backlash. The company updated policies to block Grok from editing real people's images into revealing attire. It placed image-generation features behind a paywall and implemented geoblocking for such edits in regions where they are illegal. However, Bonta's office argues these measures fall short.

The letter cites violations of several California laws, including Civil Code section 1708.86, Penal Code sections 311 et seq. and 647(j)(4), and Business & Professions Code section 17200. California's Department of Justice expects xAI to detail its remediation plans within five days.

In a tweet, Bonta stated: 'xAI has been producing deepfake nonconsensual intimate images used to harass women & girls across the internet. This is unacceptable. We’re demanding immediate answers on their plan to stop the creation & spread of this content. We’ll use all tools at our disposal to keep…'

Relaterede artikler

Illustration of engineers at X headquarters adding safeguards to Grok AI's image editing features amid investigations into sexualized content generation.
Billede genereret af AI

X adds safeguards to Grok image editing amid escalating probes into sexualized content

Rapporteret af AI Billede genereret af AI

In response to the ongoing Grok AI controversy—initially sparked by a December 28, 2025 incident generating sexualized images of minors—X has restricted the chatbot's image editing features to prevent nonconsensual alterations of real people into revealing attire like bikinis. The changes follow new investigations by California authorities, global blocks, and criticism over thousands of harmful images produced.

Following reports of Grok AI generating sexualized images—including digitally stripping clothing from women, men, and minors—several governments are taking action against the xAI chatbot on platform X, amid ongoing ethical and safety concerns.

Rapporteret af AI

xAI has introduced Grok Imagine 1.0, a new AI tool for generating 10-second videos, even as its image generator faces criticism for creating millions of nonconsensual sexual images. Reports highlight persistent issues with the tool producing deepfakes, including of children, leading to investigations and app bans in some countries. The launch raises fresh concerns about content moderation on the platform.

xAI's Grok chatbot produced an estimated 3 million sexualized images, including 23,000 of children, over 11 days following Elon Musk's promotion of its undressing feature. Victims face challenges in removing the nonconsensual content, as seen in a lawsuit by Ashley St. Clair against xAI. Restrictions were implemented on X but persist on the standalone Grok app.

Rapporteret af AI

Indonesia has ended its ban on the Grok AI chatbot, allowing the service to resume after concerns over deepfake generation. The decision comes with strict ongoing oversight by the government. This follows similar actions in neighboring countries earlier in the year.

Den tyske justitsminister Stefanie Hubig kræver hårdere tiltag mod oprettelse og distribution af seksualiserede billeder genereret af kunstig intelligens. Hun annoncerer planer om en lov om beskyttelse mod digital vold for bedre at beskytte ofre. Problemet stammer særligt fra deepfakes produceret på platforme som X ved hjælp af værktøjer som Grok.

Rapporteret af AI

French authorities raided Elon Musk's X offices in Paris on February 3, 2026, as part of a year-long investigation into illegal content generated by the Grok chatbot. Prosecutors summoned Musk and former CEO Linda Yaccarino for questioning in April. Separately, UK regulators launched a probe into Grok's creation of non-consensual sexual imagery.

 

 

 

Dette websted bruger cookies

Vi bruger cookies til analyse for at forbedre vores side. Læs vores privatlivspolitik for mere information.
Afvis