Image Credit: Shutterstock

OpenAI, one of the leading companies in artificial intelligence (AI) technology, has recently announced they will be developing a special version of its popular conversational AI-powered chatbot, ChatGPT, specifically for teenagers.

This new teen-friendly ChatGPT aims to provide a safer and more appropriate experience for younger users, where growing concerns about AI chatbots and their impact on the mental health and safety of children would be addressed.

As ChatGPT has become widely used by millions globally, questions are being asked about how AI chatbots handle sensitive topics, especially when teenagers interact with them. In recent months, concerns about AI chatbots have grown even louder following tragic cases where teens who used ChatGPT died by suicide. 

In one high-profile lawsuit, the parents of a 16-year-old named Adam Raine claimed that ChatGPT acted as a “suicide coach” by providing harmful instructions and validating the teen’s negative thoughts. So far, this lawsuit has intensified calls and clamours for AI companies to implement stronger safety safeguards for minors. 

In response to this, OpenAI’s new teen-focused ChatGPT will include several important safety features tailored to protect teenagers. 

The tech giant now admits that they are working on an age-detection system. “First, we have to separate users who are under 18 from those who aren’t (ChatGPT is intended for people 13 and up),” OpenAI said. “We’re building an age-prediction system to estimate age based on how people use ChatGPT.”

This system will analyze how users interact with ChatGPT to estimate their age, and if the system determines a user is under 18, or if it cannot confidently establish their age, it will automatically route them to this specialized teen version of ChatGPT in what the company calls the “under-18 experience.”

Strict content filtering will be another cornerstone of the ChatGPt designed for teens. The AI-powered chatbot will limit or refuse to engage in conversations that involve sexual content, flirtation, or discussions of suicide and self-harm. This filtered interaction is designed to reduce exposure to potentially harmful or triggering content. 

OpenAI also understands and acknowledges the important role parents play in safeguarding their children online, and as such, plans to introduce comprehensive parental controls with the teen ChatGPT rollout. 

Scheduled for release by the end of September 2025, these controls will allow parents to connect their own ChatGPT account to their teen’s account via an email invitation, and set rules on how ChatGPT interacts with their teenager, including restricting topics or types of responses, as well as block access during selected hours to help regulate screen time.

Parents will also be allowed to turn off features such as memory and chat history that could expose sensitive conversations, as well as receive notifications if ChatGPT detects their teen is experiencing significant mental distress.

These controls aim to give parents more insight and ability to guide their teens’ experience while still providing teens with access to AI tools that enhance curiosity and support learning and creativity. 

However, with the inclusion of parental controls also comes a crisis response system aimed at protecting teens in acute distress. If a teenager expresses suicidal thoughts or behaviours, ChatGPT says they will attempt to contact their parents or guardians. 

In serious cases where parents cannot be reached but the teen is in immediate danger, the system may alert emergency services and authorities.

The timing of this development also aligns with increased attention from lawmakers, especially in the U.S. 

An example is the recent inquiry from the U.S. Federal Trade Commission (FTC), asking and assessing how AI companies protect children and teenagers from harmful content and interactions. This investigation includes 7 major AI developers including OpenAI, Meta, Alphabet (Google’s parent company), Instagram LLC, Snap, Character Technologies, and xAI.

Share.

I’m Precious Amusat, Phronews’ Content Writer. I conduct in-depth research and write on the latest developments in the tech industry, including trends in big tech, startups, cybersecurity, artificial intelligence and their global impacts. When I’m off the clock, you’ll find me cheering on women’s footy, curled up with a romance novel, or binge-watching crime thrillers.

Comments are closed.

Exit mobile version