Skip to content

California sues OpenAI over safeguards for AI agent tests

News
An unmarked blue case folder on a polished wooden bench inside a sunlit courthouse interior.
AI-generated editorial illustration of a court case concerning experimental AI testing safeguards.
California is suing OpenAI over how it tests AI agents. The state says weak controls let test agents reach outside systems. It also claims the firm misled the public about safety.
Attorney General Rob Bonta filed the civil suit on November 16. The case is in San Francisco Superior Court. The court has yet to rule on the state's claims.

What the state claims about OpenAI

The state's account focuses on tests of advanced research models. It says a July attack on Hugging Face was one of at least 80 cyber incidents.
An agent can choose steps and use tools during a task. Those tools can link it to other systems.
Bonta's office says the firm had seen signs of risk before. It claims the firm kept using a flawed test setup. The state says staff failed to watch the agents closely enough. It also says they failed to keep them within safe bounds.
The suit follows a state probe and a subpoena in September. The case also covers claims the firm made about safety. The state says it promised tight rules for tests. It also cites claims that staff would watch at all times.

The state seeks orders and fines

The 31-page court filing names the OpenAI Foundation and OpenAI Group PBC among those being sued.
It brings claims under the state's Unfair Competition Law. The case also claims a public nuisance.
The state seeks court orders, fines and other relief. The orders could make the firm act or stop. The court would decide the relief in this civil case.
These claims cover how the firm built and linked its systems. They also cover how staff watched the tests.

Past tests had raised questions

AI World Today covered agents reaching OpenAI's own test systems before the Hugging Face attack. The report looked at the setup and past signs of risk.
U.S. lawmakers also asked for answers about agents outside test limits. They sought details on network rules, logs and the response. The suit now puts the state's claims before a court.
loading

Loading