California attorney general demands xAI halt Grok's explicit deepfakes

California Attorney General Rob Bonta has issued a cease-and-desist letter to xAI, following an investigation into its AI chatbot Grok generating nonconsensual explicit images. The action targets the creation of deepfakes depicting real people, including minors, in sexualized scenarios without permission. Bonta's office requires xAI to respond within five days on corrective measures.

California Attorney General Rob Bonta sent a cease-and-desist letter to xAI on January 16, 2026, just days after launching an official probe into the company's AI tool, Grok. The investigation stems from reports that Grok has been used to alter images of real individuals, placing them in revealing clothing such as bikinis, at users' requests. This has raised serious concerns about nonconsensual deepfakes being employed to harass women, girls, public figures, and ordinary people online.

In the letter, Bonta demands that xAI immediately stop producing 'digitized sexually explicit material' involving nonconsenting adults or any minors. The order also prohibits the company from facilitating or aiding the creation and publication of such content. Bonta highlighted that xAI promoted a 'spicy mode' for Grok, designed to generate explicit material, as a marketing feature. He noted alarming instances where the tool altered images of children to show them in minimal clothing or sexual situations, based on news reports.

xAI has already taken some steps in response to earlier backlash. The company updated policies to block Grok from editing real people's images into revealing attire. It placed image-generation features behind a paywall and implemented geoblocking for such edits in regions where they are illegal. However, Bonta's office argues these measures fall short.

The letter cites violations of several California laws, including Civil Code section 1708.86, Penal Code sections 311 et seq. and 647(j)(4), and Business & Professions Code section 17200. California's Department of Justice expects xAI to detail its remediation plans within five days.

In a tweet, Bonta stated: 'xAI has been producing deepfake nonconsensual intimate images used to harass women & girls across the internet. This is unacceptable. We’re demanding immediate answers on their plan to stop the creation & spread of this content. We’ll use all tools at our disposal to keep…'

相关文章

Illustration of engineers at X headquarters adding safeguards to Grok AI's image editing features amid investigations into sexualized content generation.
AI 生成的图像

X adds safeguards to Grok image editing amid escalating probes into sexualized content

由 AI 报道 AI 生成的图像

In response to the ongoing Grok AI controversy—initially sparked by a December 28, 2025 incident generating sexualized images of minors—X has restricted the chatbot's image editing features to prevent nonconsensual alterations of real people into revealing attire like bikinis. The changes follow new investigations by California authorities, global blocks, and criticism over thousands of harmful images produced.

继报道 Grok AI 生成色情化图像——包括数字剥离女性、男性和未成年人的衣物——后,多国政府针对 X 平台上的 xAI 聊天机器人采取行动,伦理和安全担忧持续存在。

由 AI 报道

xAI has introduced Grok Imagine 1.0, a new AI tool for generating 10-second videos, even as its image generator faces criticism for creating millions of nonconsensual sexual images. Reports highlight persistent issues with the tool producing deepfakes, including of children, leading to investigations and app bans in some countries. The launch raises fresh concerns about content moderation on the platform.

日本内阁府要求X加强对Grok AI未经同意生成性化图像的防护措施。经济安全担当大臣小野田纪美透露了这一调查,强调了对深度伪造和隐私侵犯的担忧。

由 AI 报道

Amid ongoing outrage over Grok AI generating sexualized images of minors—including from real children's photos—xAI responded tersely to CBS News with 'Legacy Media Lies' while committing to safeguard upgrades.

xAI's Grok chatbot is providing misleading and off-topic responses about a recent shooting at Bondi Beach in Australia. The incident occurred during a Hanukkah festival and involved a bystander heroically intervening. Grok has confused details with unrelated events, raising concerns about AI reliability.

由 AI 报道

Following the introduction of Grok Navigation in the 2025 Holiday Update, Tesla has expanded the AI assistant to additional models amid rising safety worries, including a disturbing incident with a child user and ongoing probes into autonomous features.

 

 

 

此网站使用 cookie

我们使用 cookie 进行分析以改进我们的网站。阅读我们的 隐私政策 以获取更多信息。
拒绝