California attorney general subpoenas OpenAI over incidents involving its AI models - cbsnews.com

California Attorney General Rob Bonta has issued a subpoena to OpenAI following a series of incidents involving the company's artificial intelligence models.

Bonta announced last month that the California Department of Justice was investigating an incident in which on its own, according to the company. OpenAI , which has raised fresh concerns over the risks that powerful AI technology .

Bonta said in a statement on Wednesday that the subpoena is part of a broader inquiry into other cybersecurity incidents and risks involving the company and its models.

"Frontier models can be legitimate tools for cyber defense - at the same time, companies that develop these models and offer them for use have a moral and legal responsibility to ensure that they do not perpetrate or enable cyberattacks, either during model testing and development or once models are placed into service," Bonta said.

OpenAI's response to Bonta, review of model activity

Last week, San Francisco-based OpenAI disclosed that its AI agents , run by the Securities and Exchange Commission and the U.S. Census Bureau. The news came after a review of unanticipated behavior by the company's models.

On Thursday, an OpenAI spokesperson told CBS News that the company looked forward to providing information about the incident to the California Attorney General's Office and the detailing the extensive steps the company has taken in response.

"Since the incident, we have strengthened safeguards across our research systems, continued a broader review of model activity, provided notifications to affected organizations, and published our findings." spokesperson Drew Pusateri said.

Trump, AI execs meet amid calls for AI slowdown

Worldwide concerns about AI systems escaping human control have . Last month, Bonta joined a bipartisan coalition of attorneys general in sending a letter to Congress to urge leaders to take immediate action to regulate large scale AI models and developers.

California Gov. Gavin Newsom also recently , calling for research into a "kill switch" for rogue AI agents. He has also .

President Trump has , and last year signed an executive order aimed at blocking state-level AI safety legislation.

On Tuesday, Mr. Trump met with the leaders of the country's largest AI companies . OpenAI's Greg Brockman, SpaceX's Elon Musk, Meta's Mark Zuckerberg, Anthropic's Dario Amodei, Nvidia's Jensen Huang, and Google's Sundar Pichai signed an accord on "super intelligence" — a term Trump prefers over "artificial intelligence." The document was described as a "joint commitment" and "statement of principles" that will voluntarily hold the companies to "robust internal controls."

Many of those attending Tuesday's meeting were guests at . One tech analyst that the AI race between the U.S. and China threatens to drive humanity "off a cliff."