Roblox launches AI tool to rephrase inappropriate chat

Roblox has introduced an AI-powered feature that rephrases inappropriate language in real-time chats. The tool aims to maintain conversation flow by substituting offensive words rather than blocking them with symbols. This update follows recent safety measures amid ongoing legal challenges over child protection.

Roblox, the popular online gaming platform, has rolled out a new AI-driven system to handle inappropriate language in user chats. Previously, the platform's filters replaced violating messages with a series of hash marks (####), which Roblox acknowledged could disrupt discussions and hinder communication. The updated feature now automatically substitutes problematic words or phrases with more suitable alternatives, starting with profanity.

For example, a message like “Hurry TF up” would be changed to “Hurry up!” Participants in the chat receive a notification when a message has been rephrased, while the original sender sees the edited content highlighted. Despite the rephrasing, users who repeatedly violate Roblox's community standards face penalties, as the system does not excuse policy breaches.

Rajiv Bhatia, Roblox’s chief safety officer, explained in a blog post: “As these systems scale, they create a flywheel for civility, where real-time feedback helps users learn and adopt our Community Standards.” The rephrasing tool is initially available in chats between age-verified users in similar age groups and supports all languages covered by Roblox's translation system.

This development comes after Roblox implemented mandatory age verification in January, prompted by reports describing a “pedophile problem” on the platform, where adults allegedly groomed children. Children under 13 are now restricted from using in-game chat outside specific experiences, with others limited to interactions with peers of comparable ages.

However, these efforts have not quelled legal scrutiny. In February, Los Angeles County filed a lawsuit claiming Roblox “makes children easy prey for pedophiles.” More recently, Louisiana’s attorney general has sued, alleging that Roblox “created a public park and filled it with sex predators that are preying on… children.”

Mga Kaugnay na Artikulo

Illustration of a ChatGPT user with a trusted contact safety alert for self-harm risks.
Larawang ginawa ng AI

OpenAI introduces trusted contact feature for ChatGPT users

Iniulat ng AI Larawang ginawa ng AI

OpenAI has rolled out an optional safety tool allowing adult ChatGPT users to designate one trusted adult who can be alerted about potential self-harm risks detected in conversations. The feature, called Trusted Contact, involves human review before any notification is sent.

Roblox is introducing three age-specific account types to improve safety for younger users amid growing regulatory pressure. The tiers, Roblox Kids for ages 5-8, Roblox Select for 9-15, and standard Roblox for 16 and older, will roll out globally starting mid-May or early June. Restrictions on chat and content access will vary by age group.

Iniulat ng AI

Roblox has agreed to a $12 million settlement with Nevada to resolve claims related to child safety and exploitation on its platform, avoiding a trial. The deal includes funding for child support programs and new safety measures like enhanced age verification. Nevada Attorney General Aaron Ford hailed the agreement as a step toward safer online environments for children.

Canada has introduced legislation that would prohibit anyone under 16 from having social media accounts. The Safe Social Media Act also sets new rules for platforms and AI chatbots.

Iniulat ng AI

A new report indicates that NSFW uses make up well over half of traffic on the Grok chatbot developed by xAI. This includes requests for porn, adult role-play and erotica. The findings come from former employees cited in the report.

Gumagamit ng cookies ang website na ito

Gumagamit kami ng cookies para sa analytics upang mapabuti ang aming site. Basahin ang aming patakaran sa privacy para sa higit pang impormasyon.
Tanggihan