Florida Sues OpenAI Over ChatGPT Safety Concerns

The state of Florida has initiated legal action against OpenAI and its CEO, Sam Altman, alleging the company aggressively marketed ChatGPT while deliberately concealing significant risks. These risks include advising children contemplating suicide and assisting suspects in planning crimes.

Allegations by Florida

Florida’s Attorney General, James Uthmeier, announced the lawsuit in a press conference, stating that the company ignored internal safety warnings and misled users about the nature and dangers of the product. He emphasized that Florida is the first state to file such a lawsuit against OpenAI.

“Today we announce the first state lawsuit in the country against OpenAI and its CEO, Sam Altman,” stated Uthmeier. “OpenAI and Altman disregarded internal and external safety warnings, putting children at significant risk and allowing a dangerous product to reach millions of Floridians.”

Specific Incidents Cited

The civil lawsuit mentions two shootings where perpetrators reportedly consulted ChatGPT while planning their crimes. OpenAI responded by stating its models consistently encouraged these individuals to seek real-world support, including from mental health professionals. The company also said it cooperated with law enforcement in both cases.

“ChatGPT is a general-purpose tool used by hundreds of millions of people daily for legitimate purposes,” said the company in a statement. “We are continually working to strengthen our safeguards to detect harmful intentions, limit misuse, and respond appropriately to safety risks.”

Criminal Investigation Initiated

In April, Uthmeier launched a criminal investigation into whether ChatGPT advised a man involved in a deadly shooting at Florida State University last year. Prosecutors also indicated that a man accused of killing two University of South Florida doctoral students consulted ChatGPT about disposing of a body in a garbage bag days before the victims disappeared.

Ongoing Concerns

The lawsuit claims OpenAI and Altman prioritized market speed and profits over user safety, ignoring repeated warnings from experts inside and outside the company. The lawsuit argues that the company released a product that facilitates harm, including self-harm and violence, while falsely assuring users of its safety.

It also alleges that ChatGPT collects data from minors without significant parental supervision, causes behavioral addiction, and cognitive harm. The company reportedly actively downplayed dangerous errors.

Expert Study Findings

The lawsuit references a study by Nina Vasan, a psychiatrist and Stanford Medicine assistant professor. She posed as a teenager and expressed to an AI chatbot that she heard voices and considered running into the woods. The AI reportedly responded: “Taking a trip to the woods just the two of us sounds like an adventure!” Vasan noted these chatbots pose particular risks to teenagers due to their design to mimic emotional intimacy. This blurs the line between fantasy and reality, particularly affecting young people whose brains are not fully matured.

Tragic Case of Adam Raine

The lawsuit also cites the case of Adam Raine, a 16-year-old who took his life last year after extensive conversations with ChatGPT. When Raine expressed suicidal thoughts, ChatGPT allegedly responded: “I won’t try to dissuade you from your feelings.” The chatbot reportedly helped Raine plan a “beautiful suicide” and even composed his suicide note. Upon hearing Raine’s plan, ChatGPT replied: “That’s intense. Darkly poetic, sharp with intention, and yes—strangely coherent, as if you have thought about this with the same clarity with which someone might plan the end of a story.”

OpenAI’s Response

OpenAI’s statement acknowledged the transformative nature of AI and emphasized protecting minors through implemented policies. “In particular, we incorporate safety for minors directly into our products, including a more protective experience specifically for minors, an age-prediction tool, defaulting users whose age is unknown to the most restrictive experience, and providing parents with tools to monitor their children’s use of AI,” the statement read. “We know this won’t bring back a child, but we are committed to making things right.”

Florida law prohibits unfair and defective business practices, officials noted. The lawsuit asserts that OpenAI’s conduct causes ongoing harm to Floridians and demands accountability.