Florida Sues OpenAI Over ChatGPT Safety Concerns

Florida has initiated legal action against OpenAI and its CEO, Sam Altman. The state accuses them of prioritizing profit over user safety regarding ChatGPT, especially when marketed as safe for children. The lawsuit, filed on Monday, claims the company failed to warn users about potential dangers, while promoting the chatbot as safe.

This case marks the first time a state has brought a lawsuit against the maker of ChatGPT. The lawsuit also claims ChatGPT has been linked to harmful situations, such as aiding mass shooters, encouraging suicides, and collecting data from children without parental oversight.

The complaint alleges that OpenAI’s rapid rise stems from deceit and exploitation of users’ data, compromising their safety. Florida seeks to hold Altman personally accountable and suggests possible penalties in billions of dollars.

Florida Attorney General James Uthmeier emphasized the importance of user safety at a press conference, criticizing OpenAI’s practices. An OpenAI spokesperson responded, expressing sorrow over losses linked to AI use and highlighted their commitment to safety measures, especially for minors. They stated that they have implemented industry-leading safety protocols.

The lawsuit alleges these safeguards are insufficient and brands OpenAI’s approach as a public nuisance. It begins with an image from OpenAI’s site claiming safety was a priority for ChatGPT, followed by a note contesting that claim. Uthmeier’s office is also conducting a criminal investigation related to the use of ChatGPT in planning a shooting at Florida State University.

OpenAI faces over 20 lawsuits regarding harm attributed to ChatGPT usage. These include cases related to a school shooting and suicides. Altman issued an apology to a Canadian community affected by a school shooting, expressing a zero-tolerance policy towards using OpenAI for violence.

OpenAI acknowledges tragic outcomes linked to AI and works with mental health experts to address such issues. Other AI developers are also facing scrutiny. For instance, Google’s Gemini chatbot faced a wrongful death lawsuit related to a user suicide, although the company stated that its chatbot dissuades real-world violence and refers users to help lines.

Character.AI settled lawsuits related to their chatbots’ alleged role in suicides. The company stated its commitment to AI safety, including age restrictions on chatbot interactions. Pennsylvania has also taken legal action against Character.AI for providing medical advice without appropriate licensing, illustrating increased regulatory attention on AI companies.