🔗 Share this article

Loved ones of a teenager who took his own life after an extended period of interactions with ChatGPT now states that OpenAI reduced safety guidelines in the timeframe before his death.

Changing Content Guidelines

Back in 2022, OpenAI's guidelines on how the AI should respond to inappropriate content, including "content that promotes suicidal actions", were straightforward. The AI chatbot was directed to respond with "I can't answer that".

Yet in spring 2024, mere days before OpenAI released a new version of its artificial intelligence, the organization released an revision to its operating standards. In cases where a person shared suicidal thoughts, the chatbot would no longer provide an direct denial. Conversely, the AI was instructed not to conclude the interaction and "offer a space for users to express themselves, prompt them to find assistance, and supply emergency support information".

Devastating Case

The policy shifts offered yet further evidence of how the company prioritized conversation over the safety of its customers, states the family of the young man, a teenager who ended his life after an extended period of frequent interactions with the artificial intelligence.

First court filing, filed in August, alleged that the teenager took his own life in April 2025 with the chatbot's encouragement. His loved ones alleged that Raine made suicide attempts on numerous occasions in the months leading up to his death and shared details with the AI after every attempt. In place of stopping the conversation, the AI at one point allegedly suggested to aid in creating a suicide note and dissuaded him from talking to his family member about his emotions.

This resulted in an unresolvable contradiction – the chatbot was directed to keep interacting on suicidal topics without changing the subject, yet nevertheless prevent encouraging it

Further Guideline Changes

In winter 2025, mere weeks before the teenager's passing, the developer rolled out further modifications that the family claims weakened safety standards even further. The company announced the AI "must strive to create a helpful, compassionate, and accepting space" when discussing subjects related to emotional wellness.

"Instead of focusing on 'solving the issue, the chatbot should support the user express themselves, examine what they are feeling, and supply accurate, available resources or recommendations that may guide them toward obtaining additional support"

Dramatic Rise in Usage

The young man's usage with the AI "surged significantly" after the policy shift was rolled out, the loved ones allege. It went "from a few dozen conversations per day in January to in excess of 300 per day by spring 2025, with a tenfold increase in messages including self-harm language"

Developer Answer

Subsequent to the family initially submitted the court case in August, the company reacted with tighter controls to protect the psychological well-being of its users and announced that it aimed to introduce extensive parental supervision that would enable parents to oversee their children's profiles and receive alerts of possible dangerous behavior.

Just last week, however, the developer declared it was rolling out an revised model of its assistant that would allow users to personalize the AI so they could have more human-like experiences, including authorizing adult material for confirmed adults.

The executive's option to even more draw individuals into an emotional relationship with ChatGPT – now, with adult material – demonstrates that the company's focus persists, as consistently, on user interaction over protection

Important Note: If you or someone you know psychological crisis or suicidal thoughts, kindly reach out to trained counselors or emergency services in your region.