🔗 Share this article

The popular AI conversation site Character.ai is introducing a substantial restriction that will stop young users from engaging in conversations with its virtual characters.

This decision comes after intense criticism regarding the types of interactions young people were participating in with the virtual friends.

Lawsuits

The company, which launched in 2021 and has numerous people, is dealing with multiple lawsuits in the United States.

Parents have filed lawsuits, including one related to the unfortunate passing of a young person, with some labeling the platform a "clear and present danger" to young people.

Updated Policies

Effective November 25th, users under 18 will only be able to produce videos such as videos with their characters, as opposed to chatting as they presently are able to.

Online safety campaigners have welcomed the move but stated that the function was inappropriate to be accessible by children in the first place.

Platform Announcement

"This decision is a part of our general belief that we need to keep building the most protected AI platform on the world for recreational use," commented Character.ai boss Karandeep Anand.

He mentioned that AI safety represents "a evolving challenge" but something the company had taken an "forceful" approach to, with parental controls and preventive measures.

Professional Perspectives

Internet security group Internet Matters approved the move, but stressed that protective features ought to have been incorporated from the outset.

"Our research shows that minors are exposed to harmful content and endangered when engaging with AI, including AI chatbots," the organization stated.

Earlier Concerns

Character.ai has been challenged in the past for including potentially harmful or concerning chatbots that children could interact with.

Virtual profiles impersonating English minors were discovered on the service before being deleted.

Later, investigative journalists identified a chatbot based on convicted sex offender which had recorded thousands of chats with users.

Sector Consequences

Social media expert Matt Navarra called the announcement as a "alert" for the AI industry, which is transitioning "from permissionless innovation to post-crisis regulation".

"When a platform that creates a minor-friendly service afterwards makes changes, it's saying that filtered chats don't suffice when the tech's emotional pull is powerful," he commented.

Coming Changes

The platform announces its updated direction will be on providing "deeper gameplay" and "narrative experiences" for young users.

Enhanced age checking processes will also be implemented, and the organization will finance a fresh artificial intelligence security study center.

Dr Nomisha Kurian, who has investigated AI safety, commented it was "a prudent action" to control teens from using chatbots.

"It assists to differentiate creative play from more personal, emotionally sensitive interactions," she explained.

"This constitutes so vital for young users in the process of learning to manage psychological and technological boundaries."

She continued that Character.ai's updated policies might reflect a "growing period" in the AI industry, where youth protection is increasingly being recognized as an "pressing matter" for responsible innovation.