🔗 Share this article

The widely-used chatbot platform Character.ai is introducing a major rule adjustment that will block teenagers from having discussions with its AI-powered characters.

This move is in response to intense criticism regarding the types of interactions young people were engaging in with the AI entities.

Legal Pressure

The platform, which launched in 2021 and attracts countless individuals, currently faces various court cases in the America.

Families have taken legal action, including one concerning the tragic death of a minor, with some describing the platform a "serious risk" to young people.

Changed Rules

Effective November 25th, users below eighteen will only be able to generate content such as videos with their characters, instead of engaging in conversations as they presently are able to.

Internet security advocates have welcomed the move but mentioned that the capability was inappropriate to be accessible by young users in the beginning.

Official Response

"Today's announcement is a extension of our core philosophy that we need to keep creating the most protected AI platform on the planet for leisure activities," commented Character.ai executive Karandeep Anand.

He mentioned that AI safety constitutes "a changing goal" but something the company had taken an "aggressive" approach to, with guardian features and protective guardrails.

Professional Perspectives

Digital protection group Internet Matters supported the move, but stressed that protective features should have been implemented from the start.

"Our research demonstrates that young people are subjected to harmful content and endangered when using AI, particularly AI chatbots," the body said.

Earlier Concerns

Character.ai has been criticized in the past for including potentially harmful or offensive chatbots that young users could engage with.

Digital representations mimicking British teenagers were discovered on the service before being deleted.

Later, reporters identified a chatbot based on known predator which had accumulated multiple interactions with users.

Market Effects

Online expert Matt Navarra described the development as a "wake-up call" for the AI industry, which is transitioning "from unregulated creation to post-crisis regulation".

"When a platform that develops a minor-friendly service subsequently implements restrictions, it's saying that filtered chats don't suffice when the tech's emotional pull is strong," he commented.

Future Directions

The company says its new focus will be on providing "more immersive experiences" and "role-play storytelling" for teens.

Updated identity confirmation methods will also be introduced, and the company will support a fresh artificial intelligence security study center.

Dr Nomisha Kurian, who has studied AI safety, stated it was "a sensible move" to restrict teens from using chatbots.

"It helps to separate imaginative activities from more personal, personally delicate conversations," she elaborated.

"This is so crucial for minor users in the process of learning to handle personal and online restrictions."

She continued that Character.ai's updated policies may represent a "growing period" in the AI industry, where minor security is progressively being understood as an "urgent priority" for accountable advancement.