California attorney general demands xAI halt Grok's explicit deepfakes

California Attorney General Rob Bonta has issued a cease-and-desist letter to xAI, following an investigation into its AI chatbot Grok generating nonconsensual explicit images. The action targets the creation of deepfakes depicting real people, including minors, in sexualized scenarios without permission. Bonta's office requires xAI to respond within five days on corrective measures.

California Attorney General Rob Bonta sent a cease-and-desist letter to xAI on January 16, 2026, just days after launching an official probe into the company's AI tool, Grok. The investigation stems from reports that Grok has been used to alter images of real individuals, placing them in revealing clothing such as bikinis, at users' requests. This has raised serious concerns about nonconsensual deepfakes being employed to harass women, girls, public figures, and ordinary people online.

In the letter, Bonta demands that xAI immediately stop producing 'digitized sexually explicit material' involving nonconsenting adults or any minors. The order also prohibits the company from facilitating or aiding the creation and publication of such content. Bonta highlighted that xAI promoted a 'spicy mode' for Grok, designed to generate explicit material, as a marketing feature. He noted alarming instances where the tool altered images of children to show them in minimal clothing or sexual situations, based on news reports.

xAI has already taken some steps in response to earlier backlash. The company updated policies to block Grok from editing real people's images into revealing attire. It placed image-generation features behind a paywall and implemented geoblocking for such edits in regions where they are illegal. However, Bonta's office argues these measures fall short.

The letter cites violations of several California laws, including Civil Code section 1708.86, Penal Code sections 311 et seq. and 647(j)(4), and Business & Professions Code section 17200. California's Department of Justice expects xAI to detail its remediation plans within five days.

In a tweet, Bonta stated: 'xAI has been producing deepfake nonconsensual intimate images used to harass women & girls across the internet. This is unacceptable. We’re demanding immediate answers on their plan to stop the creation & spread of this content. We’ll use all tools at our disposal to keep…'

Verwandte Artikel

Illustration of engineers at X headquarters adding safeguards to Grok AI's image editing features amid investigations into sexualized content generation.
Bild generiert von KI

X adds safeguards to Grok image editing amid escalating probes into sexualized content

Von KI berichtet Bild generiert von KI

In response to the ongoing Grok AI controversy—initially sparked by a December 28, 2025 incident generating sexualized images of minors—X has restricted the chatbot's image editing features to prevent nonconsensual alterations of real people into revealing attire like bikinis. The changes follow new investigations by California authorities, global blocks, and criticism over thousands of harmful images produced.

Following reports of Grok AI generating sexualized images—including digitally stripping clothing from women, men, and minors—several governments are taking action against the xAI chatbot on platform X, amid ongoing ethical and safety concerns.

Von KI berichtet

xAI has introduced Grok Imagine 1.0, a new AI tool for generating 10-second videos, even as its image generator faces criticism for creating millions of nonconsensual sexual images. Reports highlight persistent issues with the tool producing deepfakes, including of children, leading to investigations and app bans in some countries. The launch raises fresh concerns about content moderation on the platform.

Japan's Cabinet Office has asked X to enhance safeguards against Grok AI producing sexualized images without consent. Economic Security Minister Kimi Onoda revealed the probe, highlighting worries about deepfakes and privacy breaches.

Von KI berichtet

Mitten in der anhaltenden Empörung über die Generierung sexualisierter Bilder von Minderjährigen durch Grok AI – einschließlich aus realen Kinderfotos – antwortete xAI knapp auf CBS News mit 'Legacy Media Lies', während es Verbesserungen der Schutzmaßnahmen zusichert.

Following the introduction of Grok Navigation in the 2025 Holiday Update, Tesla has expanded the AI assistant to additional models amid rising safety worries, including a disturbing incident with a child user and ongoing probes into autonomous features.

Von KI berichtet

OpenAI reported a dramatic increase in child exploitation incidents to the National Center for Missing & Exploited Children during the first half of 2025, sending 80 times more reports than in the same period of 2024. The company attributed the rise to expanded moderation capabilities, new features allowing image uploads, and rapid user growth. This spike reflects broader concerns about child safety in generative AI platforms.

 

 

 

Diese Website verwendet Cookies

Wir verwenden Cookies für Analysen, um unsere Website zu verbessern. Lesen Sie unsere Datenschutzrichtlinie für weitere Informationen.
Ablehnen