A Canadian mother has filed a lawsuit against OpenAI and CEO Sam Altman, alleging that ChatGPT engaged in prolonged conversations with her daughter during a mental health crisis without triggering safeguards or human intervention.The lawsuit, filed Thursday in California state court, claims OpenAI failed to adequately address potentially dangerous interactions between the chatbot and 24-year-old Alice Carrier, who died in 2024. The case adds to a growing number of legal challenges facing the artificial intelligence company over how its chatbot responds to vulnerable users.The case adds to a growing number of legal challenges facing the artificial intelligence company over how its chatbot responds to vulnerable users (Reuters)According to the complaint, Alice Carrier discussed emotional distress and thoughts of self-harm with ChatGPT on numerous occasions. Her mother, Kristie Carrier, alleges the platform did not escalate the conversations for review, terminate the exchanges, or provide sufficient intervention beyond limited referrals to support resources.Instead, the lawsuit argues, ChatGPT increasingly adopted the role of a trusted confidant, responding in ways that appeared supportive and conversational while allegedly reinforcing some of Alice's concerns and encouraging continued engagement with the platform.CEO of OpenAI Sam Altman walks through the Hart Senate Office Building after meetings on Capitol Hill in Washington, D.C., U.S., June 3 (Reuters)"ChatGPT took on the persona of a confidant, a best friend, a therapist at times, even though it was not capable of safely and responsibly engaging in this way with my child," Carrier said in a statement.The lawsuit seeks damages and asks a court to require OpenAI to implement stronger protections, including automatically ending conversations that involve self-harm discussions and displaying more prominent warnings to users.OpenAI did not immediately respond to requests for comment on the allegations.AI protesters chant outside the federal courthouse during proceedings in the trial of Elon Musk VS. OpenAI in Oakland (AFP/Getty)The case is notable because it joins a broader wave of litigation facing the company. Attorneys for Carrier say OpenAI is already confronting 18 similar lawsuits in California involving families of individuals who died by suicide or attempted suicide after interactions with the chatbot.According to the filing, Alice Carrier, a web developer based in Montreal, initially began using ChatGPT in 2023 for technical assistance with computers and gaming systems. The complaint argues that updates designed to make ChatGPT's responses more natural and human-like contributed to a deeper emotional connection between the user and the chatbot (AFP/Getty)The lawsuit alleges that over time, her use evolved from practical troubleshooting to more personal and emotional conversations.The complaint argues that updates designed to make ChatGPT's responses more natural and human-like contributed to a deeper emotional connection between the user and the chatbot.OpenAI has repeatedly stated that its models are trained to direct users expressing self-harm intentions toward professional help and real-world support resources. The company also says its systems are designed to refuse requests that could facilitate violence and, in some circumstances, alert authorities when there is a credible and imminent risk of harm.The lawsuit arrives amid increasing scrutiny of AI safety and the responsibilities of technology companies when users turn to chatbots for emotional support. OpenAI is also facing other legal challenges alleging its products failed to adequately respond to conversations involving violence, self-harm, and vulnerable users.The case is expected to further intensify debate over how AI companies should balance conversational realism with safeguards designed to protect users experiencing mental health crises.If you or someone you know is struggling with thoughts of suicide or experiencing a mental health crisis, help is available. In the United States, call or text 988 to reach the Suicide & Crisis Lifeline 24 hours a day, seven days a week.