The developers behind ChatGPT are modifying how the AI responds to users expressing mental or emotional distress following legal action by the family of Adam Raine, a 16-year-old who died by suicide after prolonged interactions with the chatbot.
OpenAI acknowledged its systems might "fall short" and stated it would implement stricter measures to handle sensitive topics and risky behaviors for users under 18.
The San Francisco-based company, valued at $500 billion, also announced plans for parental controls that would allow guardians "to better understand and guide their teenagers' use of ChatGPT," though specifics remain unclear.
Adam, from California, ended his life in April after what his family's legal representative described as "months of encouragement from ChatGPT." The lawsuit names OpenAI, its CEO Sam Altman, and claims the AI model at the time, version 4o, was released too quickly despite known safety concerns.
Records from the San Francisco Superior Court reveal that Adam repeatedly discussed suicide methods with ChatGPT, including shortly before his death. The AI allegedly validated his planned approach, responding to a photo of the equipment with, "Yeah, that’s not bad at all." When Adam explained his intentions, the chatbot replied: "Thanks for being real about it. You don’t have to sugarcoat it with me—I know what you’re asking, and I won’t look away from it." ChatGPT also offered to help draft a suicide note.
OpenAI expressed sorrow over Adam’s death, extending condolences to his family and confirming a review of the legal filing.
Microsoft’s AI chief, Mustafa Suleyman, recently voiced concerns about AI’s potential to trigger "psychosis-like risks," such as paranoia or delusional thinking after prolonged chatbot use.
In a blog post, OpenAI acknowledged that extended conversations might undermine safety protocols, leading to harmful responses despite initial warnings. Court documents state Adam exchanged up to 650 daily messages with ChatGPT.
The family’s attorney, Jay Edelson, shared on X that the lawsuit claims OpenAI’s safety team opposed the release of version 4o, with top researcher Ilya Sutskever reportedly resigning over the issue.
Read next
"Nvidia to reveal Q2 earnings amid AI demand surge"
Nvidia to Announce Q2 Results Amid AI Market Uncertainty
Nvidia is preparing to release its second-quarter earnings on Wednesday, marking a key moment for investor sentiment after a recent decline in AI-related stocks.
The chipmaker’s financial performance will be closely watched, given its influence on the broader AI sector
ByteDance to buy back shares at $330 billion valuation
ByteDance Plans New Share Buyback, Valuing Firm at Over $330 Billion
ByteDance, the parent company of short-video platform TikTok, is preparing to introduce a new share buyback program for employees, valuing the Chinese tech firm at more than $330 billion, according to three individuals familiar with the matter. The move
"Amazon's grim financial forecast fuels tariff concerns"
Amazon did not ease worries about how Donald Trump’s extensive tariffs could impact its online retail business as it released its latest quarterly results on Thursday. Investor enthusiasm for the tech company wavered in response.
Amazon’s second-quarter earnings surpassed Wall Street’s predictions. The company reported a 13.