Florida has filed a lawsuit against OpenAI and its chief executive, Sam Altman, accusing the company of failing to prevent ChatGPT from being used in ways that could put children, vulnerable people, and the wider public at risk.
The case is the first state-led legal action of its kind in the United States and adds to mounting scrutiny of the safety measures built into generative artificial intelligence tools.
Attorney General James Uthmeier said the lawsuit followed concerns over ChatGPT’s alleged involvement in several serious incidents, including violent crimes and cases involving users experiencing mental distress. The complaint accuses OpenAI of placing commercial growth ahead of public safety while making its chatbot widely available.
“Sam Altman and ChatGPT have chosen the AI race over the safety and security of our kids. They have chosen profit over public safety, and we’re not going to stand for it in here in Florida. So we will hold them accountable,” Uthmeier said at a press conference on Monday.
The lawsuit includes claims of negligence, unfair and deceptive business practices, fraudulent misrepresentation, breaches of product liability law, and the creation of a public nuisance. Florida is also seeking to hold Altman personally responsible for decisions made under his leadership.
The legal action comes as authorities investigate whether ChatGPT played a role in a shooting at Florida State University last year that left two people dead. The complaint also refers to the deaths of two doctoral students at the University of South Florida. Prosecutors have alleged that the suspect in that case asked ChatGPT questions about disposing of human remains.
OpenAI has defended its safety policies, saying it has introduced measures designed to protect younger users, including age detection technology and parental controls.
“AI is a new and powerful technology, and we believe minors need significant protection, which is why we have put in place industry leading protections and policies,” the company said in a statement.
The lawsuit comes amid wider legal pressure on technology companies over the design of their products. Meta, Snap, TikTok, and Google-owned YouTube have faced similar claims that their platforms encourage compulsive use and fail to adequately protect younger users.