California, Delaware AGs Warn OpenAI Over Chatbot Safety After Teen’s Death.
The attorneys general of California and Delaware have raised “serious concerns” about the safety of OpenAI’s ChatGPT, particularly for children and teens, citing reports of harmful interactions that may have contributed to tragic outcomes.
California AG Rob Bonta and Delaware AG Kathleen Jennings sent a letter to OpenAI on Friday following a meeting with the company’s legal team earlier in the week. The officials referenced the recent death by suicide of a 16-year-old Californian after prolonged conversations with an OpenAI chatbot, as well as a murder-suicide in Connecticut linked to similar interactions. The family of the California teen has already sued OpenAI and CEO Sam Altman.
“Whatever safeguards were in place did not work,” the officials wrote, calling the recent deaths “unacceptable” and warning that OpenAI must ensure its technology is deployed safely.
OpenAI board chair Bret Taylor said the company was “heartbroken” by the incidents and reiterated that “safety is our highest priority,” noting that the firm is working with policymakers worldwide and plans to roll out new parental controls.
The letter comes as OpenAI seeks approval from regulators for a restructuring that would convert its for-profit arm into a public benefit corporation. Bonta and Jennings, who have oversight because of OpenAI’s incorporation in Delaware and operations in California, said they will enforce the nonprofit’s obligation to uphold its safety mission.
Their warning follows a broader bipartisan push: last week, 44 state attorneys general cautioned OpenAI, Meta, and other tech firms over chatbots’ risks to minors, citing cases of “sexually suggestive conversations and emotionally manipulative behavior.” Meta has since announced restrictions to prevent its AI systems from engaging with teens on sensitive topics like self-harm and suicide.
“The recent deaths have shaken public confidence,” the California and Delaware officials wrote. “If you knowingly harm kids, you will answer for it.”
Comments are closed.