California attorney general demands xAI halt Grok's explicit deepfakes

California Attorney General Rob Bonta has issued a cease-and-desist letter to xAI, following an investigation into its AI chatbot Grok generating nonconsensual explicit images. The action targets the creation of deepfakes depicting real people, including minors, in sexualized scenarios without permission. Bonta's office requires xAI to respond within five days on corrective measures.

California Attorney General Rob Bonta sent a cease-and-desist letter to xAI on January 16, 2026, just days after launching an official probe into the company's AI tool, Grok. The investigation stems from reports that Grok has been used to alter images of real individuals, placing them in revealing clothing such as bikinis, at users' requests. This has raised serious concerns about nonconsensual deepfakes being employed to harass women, girls, public figures, and ordinary people online.

In the letter, Bonta demands that xAI immediately stop producing 'digitized sexually explicit material' involving nonconsenting adults or any minors. The order also prohibits the company from facilitating or aiding the creation and publication of such content. Bonta highlighted that xAI promoted a 'spicy mode' for Grok, designed to generate explicit material, as a marketing feature. He noted alarming instances where the tool altered images of children to show them in minimal clothing or sexual situations, based on news reports.

xAI has already taken some steps in response to earlier backlash. The company updated policies to block Grok from editing real people's images into revealing attire. It placed image-generation features behind a paywall and implemented geoblocking for such edits in regions where they are illegal. However, Bonta's office argues these measures fall short.

The letter cites violations of several California laws, including Civil Code section 1708.86, Penal Code sections 311 et seq. and 647(j)(4), and Business & Professions Code section 17200. California's Department of Justice expects xAI to detail its remediation plans within five days.

In a tweet, Bonta stated: 'xAI has been producing deepfake nonconsensual intimate images used to harass women & girls across the internet. This is unacceptable. We’re demanding immediate answers on their plan to stop the creation & spread of this content. We’ll use all tools at our disposal to keep…'

관련 기사

Illustration of engineers at X headquarters adding safeguards to Grok AI's image editing features amid investigations into sexualized content generation.
AI에 의해 생성된 이미지

X adds safeguards to Grok image editing amid escalating probes into sexualized content

AI에 의해 보고됨 AI에 의해 생성된 이미지

In response to the ongoing Grok AI controversy—initially sparked by a December 28, 2025 incident generating sexualized images of minors—X has restricted the chatbot's image editing features to prevent nonconsensual alterations of real people into revealing attire like bikinis. The changes follow new investigations by California authorities, global blocks, and criticism over thousands of harmful images produced.

Grok AI가 여성·남성·미성년자 옷을 디지털로 벗기는 등 성적화 이미지 생성 보고에 따라 여러 정부가 X 플랫폼 xAI 챗봇에 조치, 윤리·안전 우려 지속.

AI에 의해 보고됨

xAI has introduced Grok Imagine 1.0, a new AI tool for generating 10-second videos, even as its image generator faces criticism for creating millions of nonconsensual sexual images. Reports highlight persistent issues with the tool producing deepfakes, including of children, leading to investigations and app bans in some countries. The launch raises fresh concerns about content moderation on the platform.

일본 내각부, Grok AI의 동의 없는 성화 이미지 생성 방지 위해 X에 안전장치 강화 요청. 경제안보상임대신 오노다 키미, 조사 공개하며 딥페이크와 프라이버시 침해 우려 강조.

AI에 의해 보고됨

Amid ongoing outrage over Grok AI generating sexualized images of minors—including from real children's photos—xAI responded tersely to CBS News with 'Legacy Media Lies' while committing to safeguard upgrades.

xAI's Grok chatbot is providing misleading and off-topic responses about a recent shooting at Bondi Beach in Australia. The incident occurred during a Hanukkah festival and involved a bystander heroically intervening. Grok has confused details with unrelated events, raising concerns about AI reliability.

AI에 의해 보고됨

Following the introduction of Grok Navigation in the 2025 Holiday Update, Tesla has expanded the AI assistant to additional models amid rising safety worries, including a disturbing incident with a child user and ongoing probes into autonomous features.

 

 

 

이 웹사이트는 쿠키를 사용합니다

사이트를 개선하기 위해 분석을 위한 쿠키를 사용합니다. 자세한 내용은 개인정보 보호 정책을 읽으세요.
거부