OpenAI To Expand Crisis Support, Add Parental Controls After Couple Blames ChatGPT For Son's Death
Leading global artificial intelligence company OpenAI has announced adding parental controls and emergency contact tools to its chatbot, ChatGPT, after legal action from the parents of a 16-year-old boy. The US tech giant faces a lawsuit from the parents of the teen who alleged that ChatGPT played a role in their son's suicide.
The teen had used ChatGPT for months before he died by suicide, as per reports.
Matthew and Maria Raine, parents of 16-year-old Adam Raine, sued OpenAI and CEO Sam Altman in San Francisco.
According to a New York Times report, the parents claimed that ChatGPT encouraged Adam's suicidal thoughts. They also alleged that it gave self-harm instructions and wrote a suicide note. Adam died on April 11.
In a blog shared on Tuesday, the company said, “Our goal is for our tools to be as helpful as possible to people, and as a part of this, we're continuing to improve how our models recognise and respond to signs of mental and emotional distress and connect people with care, guided by expert input.”
The leading AI company said that it was planning to share more details about how people converse with ChatGPT over emotional issues in an upcoming update. “However, recent heartbreaking cases of people using ChatGPT in the midst of acute crises weigh heavily on us, and we believe it's important to share more now,” the company noted.
The lawsuit claims OpenAI released its GPT-4o model without proper safety measures. It argued that the company was more focused on growth over user protection. The Raines seek damages and want the court to direct age verification, blocking self-harm prompts and including warnings about psychological risks in the bot.
On the incident, an OpenAI spokesperson told Reuters that the company was “saddened” by Adam's death. “While these safeguards (suicide hotlines) work best in common, short exchanges, we've learned over time that they can sometimes become less reliable in long interactions where parts of the model's safety training may degrade,” the spokesperson said.
In its blog, OpenAI said that since early 2023, the bot has avoided giving self-harm instructions and responds with empathy. Harmful replies are blocked automatically, especially for minors. If users plan to harm others, conversations are reviewed by trained staff who can ban accounts. Imminent threats may be reported to law enforcement, the company said.
“We are continuously improving how our models respond in sensitive interactions, and are currently working on targeted safety improvements across several areas,” it added.
According to OpenAI, it launched GPT-5 in August, which became the default model, improving safety by over 25% compared to GPT-4o. However, safeguards can weaken in long conversations, it acknowledged.
OpenAI is strengthening protections to ensure reliable responses over time and across chats. It's also refining the content blocking system and plans to introduce extended support and easy access to authorities as part of its future updates, it claimed.
“We will also soon introduce parental controls that give parents options to gain more insight into, and shape, how their teens use ChatGPT,” the company added.
-
Extracting Value From Battery Scrap Could Be Challenging For India | The Reason Why
A discarded lithium-ion battery still contains valuable materials such as lithium, nickel and cobalt. These can be recovered and reused. When such batteries are crushed and shredded, they produce a dark powder called black mass.
-
One El Nino, India Can Handle. Two Could Break The Granary
India's grain stocks can absorb one bad year, but a second El Nino could drain the buffer in two to three years, economists say.
-
India's Troika Of Good Luck | Joining The Dots
As Jensen Huang's exit drags Nvidia down, a cooling AI trade and resilient earnings have revived investor interest in India. A likely RBI rate hike looms.
-
Talking Points This Week: Leadership Shock At Nvidia, Earnings Strength, And The Fog Over Hormuz
The Anthropic IPO pricing and first trading day, Nvidia's upcoming earnings, and any fresh signals from Iran will set the tone for the following week.
-
Signature Play: The Classic Cocktail Is Dead. Or Is It?
Classic cocktails are disappearing from India's cocktail menus. But they're still being ordered, taught to bartenders and borrowed from. So, who's really having the last drink?
-
A New Samvat Wishlist: Inclusive Prosperity And Human Development
India has strengthened its economic foundations through infrastructure, digital access and enterprise. Its next growth chapter must deepen productivity, create better livelihoods and widen participation in prosperity.
-
Love, Sex Aur Dhokha: The Audacious Plot To Spy On Jensen Huang
A Taipei dinner, a Singapore chip buyer and a suspected Chinese asset: inside the alleged spy operation that got close to NVIDIA's Jensen Huang.
-
Ten Things I Learnt This Samvat
Patience can be a trap. Cheap stocks can stay cheap. Leverage can wipe you out. What did Samvat 2082 teach us? Niraj Shah writes on 10 lessons from the year gone by.
-
Talking Points This Week: Tech Nerves, FII Buying, And A Faraway Banking Shock
The global markets are not shining this Diwali. The exception in the large markets is, India.
-
Midterm Rally Lasted A Day. The Hard Reality Of A Divided US May Last Two Years | Opinion
Between a contested AI boom, a debt ceiling that arrives in 2027 and a president with every incentive to act alone, the next two years may prove more volatile than the first day's rally suggests.