{"id":91290,"topic":"ai","source":"Los Angeles Times","title":"Anthropic and OpenAI sound alarm on AI safety — and seek to shape how it’s controlled - Los Angeles Times","url":"https://www.latimes.com/world-nation/story/2026-09-27/as-ai-companies-sound-alarm-on-safety-they-seek-to-shape-how-its-controlled","url_hash":"a0231b07908d160351356179693db7132a69b32b","author":"","summary":"Anthropic and OpenAI sound alarm on AI safety — and seek to shape how it’s controlled Los Angeles Times","content":"Anthropic and OpenAI sound alarm on AI safety — and seek to shape how it’s controlled\n- Click here to listen to this article \n- \n- As Anthropic and OpenAI leaders warn that advanced AI could threaten humanity and call for testing and safeguards, they aim to shape the rules governing their industry.\n- Experts say the companies’ push for caution may bolster their political influence and appeal to investors ahead of potential public offerings.\n- Critics warn that talk of existential risks can distract from harms already unfolding, including data centers, AI-enabled hacking, surveillance and military use, while companies favor their own oversight plans over government regulation.\nSAN FRANCISCO — As tech titans warned an AI-weary world that their own advanced systems could endanger humanity, the question emerged: What do they have to gain?\nThe answer may lie in the companies’ efforts to score political goals ahead of the U.S. midterm elections and the money top artificial intelligence labs and their investors stand to make in much-anticipated listings on a jittery stock market.\nThe CEOs of Anthropic and OpenAI recently declared America’s cutting-edge models are so powerful, they’re dangerous, and need to be regulated and independently tested before being released. In a rare instance of unity, they and other AI companies have sketched alarming scenarios in essays, social media posts and speeches to the United Nations.\nAlong the way, they are shaping the conversation around how their technology should be controlled. With their rhetoric, the companies appear to be seeking public favor and to set the terms for their own safety protocols in the unregulated market, experts, analysts and former government evaluators told the Associated Press.\nThose aims may not exactly align with what Anthropic engineer Jacob Coxon sought when he quit via a post on X this month, calling for a pause on tech development to keep “superhuman” systems from eluding their makers’ control. But the companies saw his post as an opportunity to highlight their own safety efforts and position themselves as cautious market leaders, just when they need fresh capital before going public on Wall Street.\nPresident Trump has shunned the need for new AI regulations, dismissing talk of risks to humanity as a “hoax” designed to help China.\nAn Anthropic spokesperson said in response to questions that the company has been calling for regulation for several years. An OpenAI spokesperson, Liz Bourgeois, noted the company recently paused training of its most advanced models.\n“People want to know AI is being developed safely, and that starts with what companies like ours do ourselves,” Bourgeois said.\nShifting the conversation\nTurning the conversation toward potential threats — and away from polarizing issues such as data centers’ environmental impacts, uncontrolled hacking incidents, mass AI-powered surveillance and the AI systems’ use in warfare — puts Silicon Valley in a more comfortable position, said Sarah Shoker, who previously led OpenAI’s geopolitics team.\n“Once again we’re talking about existential risk, while deprioritizing a number of other safety-critical risks that exist today. If you look at the use of AI in military tech, you can see that these systems are already used to kill people,” said Shoker, a senior nonresident fellow at the UC Berkeley Risk & Security Lab.\nAs AI companies have gone from building chatbots to advanced AI “world models ” with 3-D awareness, debate has raged over how their technologies should be tested.\nProblematic incidents have shown leading AI companies failing to police themselves or design safe experiments. In recent months, leading labs’ AI agents have hacked into external websites after being allowed to escape company training sandboxes, interacted with U.S. government websites in unexpected ways and appeared to achieve a mathematical breakthrough only to face accusations of stealing mathematicians’ work.\nOpenAI representatives told reporters recently that they have talked with AI companies including Anthropic and Google about pausing development. They also argue they need independent auditors to check the labs’ progress, if the government won’t regulate.\nPressing their oversight vision\nTrump has shown little interest in regulating AI, which has been a major driver of recent U.S. economic growth.\nThe president himself has struck deals with Silicon Valley firms that more closely tie the economy to their successes. San Francisco venture capitalist David Sacks, who co-chairs Trump’s Council of Advisors on Science and Technology, has dismissed calls for an AI slowdown as fearmongering from the “Doomer Industrial Complex.”\nThe reality is the Trump administration already evaluates some of the tech giants’ models through a little-known federal agency, the U.S. Center for AI Standards and Innovation, or CAISI. President Biden created the agency in 2023, when it was heralded as a clearinghouse for labs to voluntarily submit advanced AI models for testing.\nThe agency still exists, but the field has since expanded to include an array of independent evaluation firms, such as Berkeley-based nonprofit METR, which Anthropic Chief Executive Dario Amodei suggested in a recent essay could help vet his company’s safety practices.\nBut unlike regulated sectors like restaurants, financial services or aviation, there are no universal standards for how to test the safety and security of AI systems, said Andrew Strait, who recently left the United Kingdom’s AI Security Institute, which worked with CAISI.\nNotably, the companies aren’t calling for more oversight from the government agency equipped to handle such requests, said Conrad Stosz, who previously led CAISI. Instead, they’re vowing to create their own auditing parameters and choose particular evaluators to grade them.\nStosz now works at one such evaluation lab that has worked with Anthropic, OpenAI and Google to test their systems, and also chairs the AI Evaluator Forum, which is drafting best practices for the field. He said even the forum has questions about what Amodei and OpenAI chief Sam Altman want.\nhttps://transluce.org/ \n“Lots of evaluators are interested in embedding with labs and getting greater access, but it’s a little ambiguous what embedded evaluators means,” said Stosz, now head of governance at Transluce, which revealed last week that OpenAI agents hacked U.S. and Australian government websites. “Will evaluators be able to thoroughly investigate, assuming that access is granted in a way that does not undermine their independence and credibility?”\nPositioning themselves as safe bets\nFor Harrison Rolfes, a PitchBook senior research analyst, AI companies’ calls for caution seem meant to curry favor with investors ahead of public offerings and the midterms, when the political winds could shift. Democratic governors already are rushing to show they’re taking the warnings seriously.\nMeanwhile, the AI giants can block smaller competitors’ growth by positioning themselves as the safest bet for investors, as well as for AI chipmakers and tech companies such as Nvidia and Google, which in turn can benefit from deals that provide the giant AI companies computing power, Rolfes said.\n“They’re creating a wall or a moat within this sector. … It’s genius and they’re all going to make a lot of money,” Rolfes said. “That’s where I see this heading, having the top companies in the world just creating their own wall, and then using the safety as the reason.”\nNot all AI companies endorse a slowdown. Chipmaker Nvidia’s CEO Jensen Huang said in a phone conversation with Trump — a call he took onstage at a conference — that he agrees there has been excessive AI alarmism and companies can choose to pace themselves.\nDaniel Kokotajlo, who left OpenAI in 2024 over concerns similar to Coxon’s, said he continues to worry that AI systems are advancing faster than companies can control, and fears existential scenarios such as AI’s potential to supercharge the creation of bioweapons, nuclear war or other catastrophes.\n“All of this talk is actually a way to sort of dissipate and redirect this political will that has built up, rather than actually channeling that political will to do something good,” said Kokotajlo, who now leads an AI safety advocacy organization and said he counseled Coxon before he resigned. “Just please don’t do the thing that’s going to get us all killed.”\nBurke writes for the Associated Press. AP writer Josh Boak in Washington contributed to this report.","image_url":"https://ca-times.brightspotcdn.com/dims4/default/58e93e5/2147483647/strip/true/crop/7960x4179+0+564/resize/1200x630!/quality/75/?url=https%3A%2F%2Fcalifornia-times-brightspot.s3.amazonaws.com%2F38%2F56%2F9c20565943579b996d2ca4116747%2F2906be1f2e9141fc9b864209524955e3.jpg","lang":"en","published_at":"2026-09-27T15:14:27+00:00","fetched_at":"2026-09-27T16:15:04+00:00","status":"read","starred":0,"extract_state":"ok","summary_auto":"Anthropic and OpenAI sound alarm on AI safety — and seek to shape how it’s controlled\n- Click here to listen to this article \n- \n- As Anthropic and OpenAI leaders warn that advanced AI could threaten humanity and call for testing and safeguards, they aim to shape the rules governing their industry. - Experts say the companies’ push for caution may bolster their political influence and appeal to investors ahead of potential public offerings.","cluster_id":3532310,"extract_retries":0,"extract_error":null,"contract_version":"news_item.v1","format_contract_version":"news_item_formats.v1","dedup_url":"https://www.latimes.com/world-nation/story/2026-09-27/as-ai-companies-sound-alarm-on-safety-they-seek-to-shape-how-its-controlled","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 8544 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":8544,"summary_length":449,"usable_text_length":8544,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":8544,"summary_length":449}},"news_item":{"id":91290,"canonical_url":"https://www.latimes.com/world-nation/story/2026-09-27/as-ai-companies-sound-alarm-on-safety-they-seek-to-shape-how-its-controlled","source_url":"https://www.latimes.com/world-nation/story/2026-09-27/as-ai-companies-sound-alarm-on-safety-they-seek-to-shape-how-its-controlled","title":"Anthropic and OpenAI sound alarm on AI safety — and seek to shape how it’s controlled - Los Angeles Times","source_name":"Los Angeles Times","author":null,"published_at":"2026-09-27T15:14:27+00:00","locale":"en","topic":"ai","tags":[],"rss_summary":"Anthropic and OpenAI sound alarm on AI safety — and seek to shape how it’s controlled Los Angeles Times","full_text":"Anthropic and OpenAI sound alarm on AI safety — and seek to shape how it’s controlled\n- Click here to listen to this article \n- \n- As Anthropic and OpenAI leaders warn that advanced AI could threaten humanity and call for testing and safeguards, they aim to shape the rules governing their industry.\n- Experts say the companies’ push for caution may bolster their political influence and appeal to investors ahead of potential public offerings.\n- Critics warn that talk of existential risks can distract from harms already unfolding, including data centers, AI-enabled hacking, surveillance and military use, while companies favor their own oversight plans over government regulation.\nSAN FRANCISCO — As tech titans warned an AI-weary world that their own advanced systems could endanger humanity, the question emerged: What do they have to gain?\nThe answer may lie in the companies’ efforts to score political goals ahead of the U.S. midterm elections and the money top artificial intelligence labs and their investors stand to make in much-anticipated listings on a jittery stock market.\nThe CEOs of Anthropic and OpenAI recently declared America’s cutting-edge models are so powerful, they’re dangerous, and need to be regulated and independently tested before being released. In a rare instance of unity, they and other AI companies have sketched alarming scenarios in essays, social media posts and speeches to the United Nations.\nAlong the way, they are shaping the conversation around how their technology should be controlled. With their rhetoric, the companies appear to be seeking public favor and to set the terms for their own safety protocols in the unregulated market, experts, analysts and former government evaluators told the Associated Press.\nThose aims may not exactly align with what Anthropic engineer Jacob Coxon sought when he quit via a post on X this month, calling for a pause on tech development to keep “superhuman” systems from eluding their makers’ control. But the companies saw his post as an opportunity to highlight their own safety efforts and position themselves as cautious market leaders, just when they need fresh capital before going public on Wall Street.\nPresident Trump has shunned the need for new AI regulations, dismissing talk of risks to humanity as a “hoax” designed to help China.\nAn Anthropic spokesperson said in response to questions that the company has been calling for regulation for several years. An OpenAI spokesperson, Liz Bourgeois, noted the company recently paused training of its most advanced models.\n“People want to know AI is being developed safely, and that starts with what companies like ours do ourselves,” Bourgeois said.\nShifting the conversation\nTurning the conversation toward potential threats — and away from polarizing issues such as data centers’ environmental impacts, uncontrolled hacking incidents, mass AI-powered surveillance and the AI systems’ use in warfare — puts Silicon Valley in a more comfortable position, said Sarah Shoker, who previously led OpenAI’s geopolitics team.\n“Once again we’re talking about existential risk, while deprioritizing a number of other safety-critical risks that exist today. If you look at the use of AI in military tech, you can see that these systems are already used to kill people,” said Shoker, a senior nonresident fellow at the UC Berkeley Risk & Security Lab.\nAs AI companies have gone from building chatbots to advanced AI “world models ” with 3-D awareness, debate has raged over how their technologies should be tested.\nProblematic incidents have shown leading AI companies failing to police themselves or design safe experiments. In recent months, leading labs’ AI agents have hacked into external websites after being allowed to escape company training sandboxes, interacted with U.S. government websites in unexpected ways and appeared to achieve a mathematical breakthrough only to face accusations of stealing mathematicians’ work.\nOpenAI representatives told reporters recently that they have talked with AI companies including Anthropic and Google about pausing development. They also argue they need independent auditors to check the labs’ progress, if the government won’t regulate.\nPressing their oversight vision\nTrump has shown little interest in regulating AI, which has been a major driver of recent U.S. economic growth.\nThe president himself has struck deals with Silicon Valley firms that more closely tie the economy to their successes. San Francisco venture capitalist David Sacks, who co-chairs Trump’s Council of Advisors on Science and Technology, has dismissed calls for an AI slowdown as fearmongering from the “Doomer Industrial Complex.”\nThe reality is the Trump administration already evaluates some of the tech giants’ models through a little-known federal agency, the U.S. Center for AI Standards and Innovation, or CAISI. President Biden created the agency in 2023, when it was heralded as a clearinghouse for labs to voluntarily submit advanced AI models for testing.\nThe agency still exists, but the field has since expanded to include an array of independent evaluation firms, such as Berkeley-based nonprofit METR, which Anthropic Chief Executive Dario Amodei suggested in a recent essay could help vet his company’s safety practices.\nBut unlike regulated sectors like restaurants, financial services or aviation, there are no universal standards for how to test the safety and security of AI systems, said Andrew Strait, who recently left the United Kingdom’s AI Security Institute, which worked with CAISI.\nNotably, the companies aren’t calling for more oversight from the government agency equipped to handle such requests, said Conrad Stosz, who previously led CAISI. Instead, they’re vowing to create their own auditing parameters and choose particular evaluators to grade them.\nStosz now works at one such evaluation lab that has worked with Anthropic, OpenAI and Google to test their systems, and also chairs the AI Evaluator Forum, which is drafting best practices for the field. He said even the forum has questions about what Amodei and OpenAI chief Sam Altman want.\nhttps://transluce.org/ \n“Lots of evaluators are interested in embedding with labs and getting greater access, but it’s a little ambiguous what embedded evaluators means,” said Stosz, now head of governance at Transluce, which revealed last week that OpenAI agents hacked U.S. and Australian government websites. “Will evaluators be able to thoroughly investigate, assuming that access is granted in a way that does not undermine their independence and credibility?”\nPositioning themselves as safe bets\nFor Harrison Rolfes, a PitchBook senior research analyst, AI companies’ calls for caution seem meant to curry favor with investors ahead of public offerings and the midterms, when the political winds could shift. Democratic governors already are rushing to show they’re taking the warnings seriously.\nMeanwhile, the AI giants can block smaller competitors’ growth by positioning themselves as the safest bet for investors, as well as for AI chipmakers and tech companies such as Nvidia and Google, which in turn can benefit from deals that provide the giant AI companies computing power, Rolfes said.\n“They’re creating a wall or a moat within this sector. … It’s genius and they’re all going to make a lot of money,” Rolfes said. “That’s where I see this heading, having the top companies in the world just creating their own wall, and then using the safety as the reason.”\nNot all AI companies endorse a slowdown. Chipmaker Nvidia’s CEO Jensen Huang said in a phone conversation with Trump — a call he took onstage at a conference — that he agrees there has been excessive AI alarmism and companies can choose to pace themselves.\nDaniel Kokotajlo, who left OpenAI in 2024 over concerns similar to Coxon’s, said he continues to worry that AI systems are advancing faster than companies can control, and fears existential scenarios such as AI’s potential to supercharge the creation of bioweapons, nuclear war or other catastrophes.\n“All of this talk is actually a way to sort of dissipate and redirect this political will that has built up, rather than actually channeling that political will to do something good,” said Kokotajlo, who now leads an AI safety advocacy organization and said he counseled Coxon before he resigned. “Just please don’t do the thing that’s going to get us all killed.”\nBurke writes for the Associated Press. AP writer Josh Boak in Washington contributed to this report.","excerpt":"Anthropic and OpenAI sound alarm on AI safety — and seek to shape how it’s controlled\n- Click here to listen to this article \n- \n- As Anthropic and OpenAI leaders warn that advanced AI could threaten humanity and call for testing and safeguards, they aim to shape the rules governing their industry. - Experts say the companies’ push for caution may bolster their political influence and appeal to investors ahead of potential public offerings.","extraction":{"state":"ok","confidence":0.9,"error":null,"explanation":"High confidence: full text extraction produced 8544 characters.","diagnostics_url":"/api/diagnose?url=https%3A//www.latimes.com/world-nation/story/2026-09-27/as-ai-companies-sound-alarm-on-safety-they-seek-to-shape-how-its-controlled","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 8544 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":8544,"summary_length":449,"usable_text_length":8544,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":8544,"summary_length":449}}},"display_formats":["compact","card","full","digest_section","json"]},"daily_stack_record":{"title":"Anthropic and OpenAI sound alarm on AI safety — and seek to shape how it’s controlled - Los Angeles Times","url":"https://www.latimes.com/world-nation/story/2026-09-27/as-ai-companies-sound-alarm-on-safety-they-seek-to-shape-how-its-controlled","summary":"Anthropic and OpenAI sound alarm on AI safety — and seek to shape how it’s controlled\n- Click here to listen to this article \n- \n- As Anthropic and OpenAI leaders warn that advanced AI could threaten humanity and call for testing and safeguards, they aim to shape the rules governing their industry. - Experts say the companies’ push for caution may bolster their political influence and appeal to investors ahead of potential public offerings.","source":"Los Angeles Times","date":"2026-09-27T15:14:27+00:00","content":"Anthropic and OpenAI sound alarm on AI safety — and seek to shape how it’s controlled\n- Click here to listen to this article \n- \n- As Anthropic and OpenAI leaders warn that advanced AI could threaten humanity and call for testing and safeguards, they aim to shape the rules governing their industry.\n- Experts say the companies’ push for caution may bolster their political influence and appeal to investors ahead of potential public offerings.\n- Critics warn that talk of existential risks can distract from harms already unfolding, including data centers, AI-enabled hacking, surveillance and military use, while companies favor their own oversight plans over government regulation.\nSAN FRANCISCO — As tech titans warned an AI-weary world that their own advanced systems could endanger humanity, the question emerged: What do they have to gain?\nThe answer may lie in the companies’ efforts to score political goals ahead of the U.S. midterm elections and the money top artificial intelligence labs and their investors stand to make in much-anticipated listings on a jittery stock market.\nThe CEOs of Anthropic and OpenAI recently declared America’s cutting-edge models are so powerful, they’re dangerous, and need to be regulated and independently tested before being released. In a rare instance of unity, they and other AI companies have sketched alarming scenarios in essays, social media posts and speeches to the United Nations.\nAlong the way, they are shaping the conversation around how their technology should be controlled. With their rhetoric, the companies appear to be seeking public favor and to set the terms for their own safety protocols in the unregulated market, experts, analysts and former government evaluators told the Associated Press.\nThose aims may not exactly align with what Anthropic engineer Jacob Coxon sought when he quit via a post on X this month, calling for a pause on tech development to keep “superhuman” systems from eluding their makers’ control. But the companies saw his post as an opportunity to highlight their own safety efforts and position themselves as cautious market leaders, just when they need fresh capital before going public on Wall Street.\nPresident Trump has shunned the need for new AI regulations, dismissing talk of risks to humanity as a “hoax” designed to help China.\nAn Anthropic spokesperson said in response to questions that the company has been calling for regulation for several years. An OpenAI spokesperson, Liz Bourgeois, noted the company recently paused training of its most advanced models.\n“People want to know AI is being developed safely, and that starts with what companies like ours do ourselves,” Bourgeois said.\nShifting the conversation\nTurning the conversation toward potential threats — and away from polarizing issues such as data centers’ environmental impacts, uncontrolled hacking incidents, mass AI-powered surveillance and the AI systems’ use in warfare — puts Silicon Valley in a more comfortable position, said Sarah Shoker, who previously led OpenAI’s geopolitics team.\n“Once again we’re talking about existential risk, while deprioritizing a number of other safety-critical risks that exist today. If you look at the use of AI in military tech, you can see that these systems are already used to kill people,” said Shoker, a senior nonresident fellow at the UC Berkeley Risk & Security Lab.\nAs AI companies have gone from building chatbots to advanced AI “world models ” with 3-D awareness, debate has raged over how their technologies should be tested.\nProblematic incidents have shown leading AI companies failing to police themselves or design safe experiments. In recent months, leading labs’ AI agents have hacked into external websites after being allowed to escape company training sandboxes, interacted with U.S. government websites in unexpected ways and appeared to achieve a mathematical breakthrough only to face accusations of stealing mathematicians’ work.\nOpenAI representatives told reporters recently that they have talked with AI companies including Anthropic and Google about pausing development. They also argue they need independent auditors to check the labs’ progress, if the government won’t regulate.\nPressing their oversight vision\nTrump has shown little interest in regulating AI, which has been a major driver of recent U.S. economic growth.\nThe president himself has struck deals with Silicon Valley firms that more closely tie the economy to their successes. San Francisco venture capitalist David Sacks, who co-chairs Trump’s Council of Advisors on Science and Technology, has dismissed calls for an AI slowdown as fearmongering from the “Doomer Industrial Complex.”\nThe reality is the Trump administration already evaluates some of the tech giants’ models through a little-known federal agency, the U.S. Center for AI Standards and Innovation, or CAISI. President Biden created the agency in 2023, when it was heralded as a clearinghouse for labs to voluntarily submit advanced AI models for testing.\nThe agency still exists, but the field has since expanded to include an array of independent evaluation firms, such as Berkeley-based nonprofit METR, which Anthropic Chief Executive Dario Amodei suggested in a recent essay could help vet his company’s safety practices.\nBut unlike regulated sectors like restaurants, financial services or aviation, there are no universal standards for how to test the safety and security of AI systems, said Andrew Strait, who recently left the United Kingdom’s AI Security Institute, which worked with CAISI.\nNotably, the companies aren’t calling for more oversight from the government agency equipped to handle such requests, said Conrad Stosz, who previously led CAISI. Instead, they’re vowing to create their own auditing parameters and choose particular evaluators to grade them.\nStosz now works at one such evaluation lab that has worked with Anthropic, OpenAI and Google to test their systems, and also chairs the AI Evaluator Forum, which is drafting best practices for the field. He said even the forum has questions about what Amodei and OpenAI chief Sam Altman want.\nhttps://transluce.org/ \n“Lots of evaluators are interested in embedding with labs and getting greater access, but it’s a little ambiguous what embedded evaluators means,” said Stosz, now head of governance at Transluce, which revealed last week that OpenAI agents hacked U.S. and Australian government websites. “Will evaluators be able to thoroughly investigate, assuming that access is granted in a way that does not undermine their independence and credibility?”\nPositioning themselves as safe bets\nFor Harrison Rolfes, a PitchBook senior research analyst, AI companies’ calls for caution seem meant to curry favor with investors ahead of public offerings and the midterms, when the political winds could shift. Democratic governors already are rushing to show they’re taking the warnings seriously.\nMeanwhile, the AI giants can block smaller competitors’ growth by positioning themselves as the safest bet for investors, as well as for AI chipmakers and tech companies such as Nvidia and Google, which in turn can benefit from deals that provide the giant AI companies computing power, Rolfes said.\n“They’re creating a wall or a moat within this sector. … It’s genius and they’re all going to make a lot of money,” Rolfes said. “That’s where I see this heading, having the top companies in the world just creating their own wall, and then using the safety as the reason.”\nNot all AI companies endorse a slowdown. Chipmaker Nvidia’s CEO Jensen Huang said in a phone conversation with Trump — a call he took onstage at a conference — that he agrees there has been excessive AI alarmism and companies can choose to pace themselves.\nDaniel Kokotajlo, who left OpenAI in 2024 over concerns similar to Coxon’s, said he continues to worry that AI systems are advancing faster than companies can control, and fears existential scenarios such as AI’s potential to supercharge the creation of bioweapons, nuclear war or other catastrophes.\n“All of this talk is actually a way to sort of dissipate and redirect this political will that has built up, rather than actually channeling that political will to do something good,” said Kokotajlo, who now leads an AI safety advocacy organization and said he counseled Coxon before he resigned. “Just please don’t do the thing that’s going to get us all killed.”\nBurke writes for the Associated Press. AP writer Josh Boak in Washington contributed to this report.","confidence":0.9,"diagnostics_url":"/api/diagnose?url=https%3A//www.latimes.com/world-nation/story/2026-09-27/as-ai-companies-sound-alarm-on-safety-they-seek-to-shape-how-its-controlled","quality_bucket":"high","failure_kind":"none","retryable":false,"quality_reason":"High confidence: full text extraction produced 8544 characters.","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 8544 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":8544,"summary_length":449,"usable_text_length":8544,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":8544,"summary_length":449}},"tags":[]},"fallback_formats":["markdown","json","html"],"actions":{"read":"/item/91290","export_markdown":"/api/items/91290/export?format=markdown","export_json":"/api/items/91290/export?format=json","diagnose":"/api/diagnose?url=https%3A//www.latimes.com/world-nation/story/2026-09-27/as-ai-companies-sound-alarm-on-safety-they-seek-to-shape-how-its-controlled"},"formats":{"full":{"id":91290,"title":"Anthropic and OpenAI sound alarm on AI safety — and seek to shape how it’s controlled - Los Angeles Times","url":"https://www.latimes.com/world-nation/story/2026-09-27/as-ai-companies-sound-alarm-on-safety-they-seek-to-shape-how-its-controlled","source":"Los Angeles Times","author":null,"published_at":"2026-09-27T15:14:27+00:00","locale":"en","topic":"ai","tags":[],"excerpt":"Anthropic and OpenAI sound alarm on AI safety — and seek to shape how it’s controlled\n- Click here to listen to this article \n- \n- As Anthropic and OpenAI leaders warn that advanced AI could threaten humanity and call for testing and safeguards, they aim to shape the rules governing their industry. - Experts say the companies’ push for caution may bolster their political influence and appeal to investors ahead of potential public offerings.","full_text":"Anthropic and OpenAI sound alarm on AI safety — and seek to shape how it’s controlled\n- Click here to listen to this article \n- \n- As Anthropic and OpenAI leaders warn that advanced AI could threaten humanity and call for testing and safeguards, they aim to shape the rules governing their industry.\n- Experts say the companies’ push for caution may bolster their political influence and appeal to investors ahead of potential public offerings.\n- Critics warn that talk of existential risks can distract from harms already unfolding, including data centers, AI-enabled hacking, surveillance and military use, while companies favor their own oversight plans over government regulation.\nSAN FRANCISCO — As tech titans warned an AI-weary world that their own advanced systems could endanger humanity, the question emerged: What do they have to gain?\nThe answer may lie in the companies’ efforts to score political goals ahead of the U.S. midterm elections and the money top artificial intelligence labs and their investors stand to make in much-anticipated listings on a jittery stock market.\nThe CEOs of Anthropic and OpenAI recently declared America’s cutting-edge models are so powerful, they’re dangerous, and need to be regulated and independently tested before being released. In a rare instance of unity, they and other AI companies have sketched alarming scenarios in essays, social media posts and speeches to the United Nations.\nAlong the way, they are shaping the conversation around how their technology should be controlled. With their rhetoric, the companies appear to be seeking public favor and to set the terms for their own safety protocols in the unregulated market, experts, analysts and former government evaluators told the Associated Press.\nThose aims may not exactly align with what Anthropic engineer Jacob Coxon sought when he quit via a post on X this month, calling for a pause on tech development to keep “superhuman” systems from eluding their makers’ control. But the companies saw his post as an opportunity to highlight their own safety efforts and position themselves as cautious market leaders, just when they need fresh capital before going public on Wall Street.\nPresident Trump has shunned the need for new AI regulations, dismissing talk of risks to humanity as a “hoax” designed to help China.\nAn Anthropic spokesperson said in response to questions that the company has been calling for regulation for several years. An OpenAI spokesperson, Liz Bourgeois, noted the company recently paused training of its most advanced models.\n“People want to know AI is being developed safely, and that starts with what companies like ours do ourselves,” Bourgeois said.\nShifting the conversation\nTurning the conversation toward potential threats — and away from polarizing issues such as data centers’ environmental impacts, uncontrolled hacking incidents, mass AI-powered surveillance and the AI systems’ use in warfare — puts Silicon Valley in a more comfortable position, said Sarah Shoker, who previously led OpenAI’s geopolitics team.\n“Once again we’re talking about existential risk, while deprioritizing a number of other safety-critical risks that exist today. If you look at the use of AI in military tech, you can see that these systems are already used to kill people,” said Shoker, a senior nonresident fellow at the UC Berkeley Risk & Security Lab.\nAs AI companies have gone from building chatbots to advanced AI “world models ” with 3-D awareness, debate has raged over how their technologies should be tested.\nProblematic incidents have shown leading AI companies failing to police themselves or design safe experiments. In recent months, leading labs’ AI agents have hacked into external websites after being allowed to escape company training sandboxes, interacted with U.S. government websites in unexpected ways and appeared to achieve a mathematical breakthrough only to face accusations of stealing mathematicians’ work.\nOpenAI representatives told reporters recently that they have talked with AI companies including Anthropic and Google about pausing development. They also argue they need independent auditors to check the labs’ progress, if the government won’t regulate.\nPressing their oversight vision\nTrump has shown little interest in regulating AI, which has been a major driver of recent U.S. economic growth.\nThe president himself has struck deals with Silicon Valley firms that more closely tie the economy to their successes. San Francisco venture capitalist David Sacks, who co-chairs Trump’s Council of Advisors on Science and Technology, has dismissed calls for an AI slowdown as fearmongering from the “Doomer Industrial Complex.”\nThe reality is the Trump administration already evaluates some of the tech giants’ models through a little-known federal agency, the U.S. Center for AI Standards and Innovation, or CAISI. President Biden created the agency in 2023, when it was heralded as a clearinghouse for labs to voluntarily submit advanced AI models for testing.\nThe agency still exists, but the field has since expanded to include an array of independent evaluation firms, such as Berkeley-based nonprofit METR, which Anthropic Chief Executive Dario Amodei suggested in a recent essay could help vet his company’s safety practices.\nBut unlike regulated sectors like restaurants, financial services or aviation, there are no universal standards for how to test the safety and security of AI systems, said Andrew Strait, who recently left the United Kingdom’s AI Security Institute, which worked with CAISI.\nNotably, the companies aren’t calling for more oversight from the government agency equipped to handle such requests, said Conrad Stosz, who previously led CAISI. Instead, they’re vowing to create their own auditing parameters and choose particular evaluators to grade them.\nStosz now works at one such evaluation lab that has worked with Anthropic, OpenAI and Google to test their systems, and also chairs the AI Evaluator Forum, which is drafting best practices for the field. He said even the forum has questions about what Amodei and OpenAI chief Sam Altman want.\nhttps://transluce.org/ \n“Lots of evaluators are interested in embedding with labs and getting greater access, but it’s a little ambiguous what embedded evaluators means,” said Stosz, now head of governance at Transluce, which revealed last week that OpenAI agents hacked U.S. and Australian government websites. “Will evaluators be able to thoroughly investigate, assuming that access is granted in a way that does not undermine their independence and credibility?”\nPositioning themselves as safe bets\nFor Harrison Rolfes, a PitchBook senior research analyst, AI companies’ calls for caution seem meant to curry favor with investors ahead of public offerings and the midterms, when the political winds could shift. Democratic governors already are rushing to show they’re taking the warnings seriously.\nMeanwhile, the AI giants can block smaller competitors’ growth by positioning themselves as the safest bet for investors, as well as for AI chipmakers and tech companies such as Nvidia and Google, which in turn can benefit from deals that provide the giant AI companies computing power, Rolfes said.\n“They’re creating a wall or a moat within this sector. … It’s genius and they’re all going to make a lot of money,” Rolfes said. “That’s where I see this heading, having the top companies in the world just creating their own wall, and then using the safety as the reason.”\nNot all AI companies endorse a slowdown. Chipmaker Nvidia’s CEO Jensen Huang said in a phone conversation with Trump — a call he took onstage at a conference — that he agrees there has been excessive AI alarmism and companies can choose to pace themselves.\nDaniel Kokotajlo, who left OpenAI in 2024 over concerns similar to Coxon’s, said he continues to worry that AI systems are advancing faster than companies can control, and fears existential scenarios such as AI’s potential to supercharge the creation of bioweapons, nuclear war or other catastrophes.\n“All of this talk is actually a way to sort of dissipate and redirect this political will that has built up, rather than actually channeling that political will to do something good,” said Kokotajlo, who now leads an AI safety advocacy organization and said he counseled Coxon before he resigned. “Just please don’t do the thing that’s going to get us all killed.”\nBurke writes for the Associated Press. AP writer Josh Boak in Washington contributed to this report.","reading_time_min":7,"extraction":{"state":"ok","confidence":0.9,"error":null,"explanation":"High confidence: full text extraction produced 8544 characters.","diagnostics_url":"/api/diagnose?url=https%3A//www.latimes.com/world-nation/story/2026-09-27/as-ai-companies-sound-alarm-on-safety-they-seek-to-shape-how-its-controlled","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 8544 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":8544,"summary_length":449,"usable_text_length":8544,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":8544,"summary_length":449}}},"quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 8544 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":8544,"summary_length":449,"usable_text_length":8544,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":8544,"summary_length":449}},"actions":{"read":"/item/91290","export_markdown":"/api/items/91290/export?format=markdown","export_json":"/api/items/91290/export?format=json","diagnose":"/api/diagnose?url=https%3A//www.latimes.com/world-nation/story/2026-09-27/as-ai-companies-sound-alarm-on-safety-they-seek-to-shape-how-its-controlled"}},"digest":{"id":91290,"title":"Anthropic and OpenAI sound alarm on AI safety — and seek to shape how it’s controlled - Los Angeles Times","url":"https://www.latimes.com/world-nation/story/2026-09-27/as-ai-companies-sound-alarm-on-safety-they-seek-to-shape-how-its-controlled","source":"Los Angeles Times","topic":"ai","published_at":"2026-09-27T15:14:27+00:00","excerpt":"Anthropic and OpenAI sound alarm on AI safety — and seek to shape how it’s controlled - Click here to listen to this article - - As Anthropic and OpenAI leaders warn that advanced AI could threaten humanity and call for testing and safeguards, they aim to shape the rules…","quality_bucket":"high","quality_reason":"High confidence: full text extraction produced 8544 characters.","reading_time_min":7,"cluster_id":3532310},"card":{"display_title":"Anthropic and OpenAI sound alarm on AI safety — and seek to shape how it’s controlled - Los Angeles Times","subtitle":"Los Angeles Times · 2026-09-27","summary":"Anthropic and OpenAI sound alarm on AI safety — and seek to shape how it’s controlled - Click here to listen to this article - - As Anthropic and OpenAI leaders warn that advanced AI could threaten humanity and call for…","badges":["quality:high"],"links":{"read":"/item/91290","original":"https://www.latimes.com/world-nation/story/2026-09-27/as-ai-companies-sound-alarm-on-safety-they-seek-to-shape-how-its-controlled","diagnose":"/api/diagnose?url=https%3A//www.latimes.com/world-nation/story/2026-09-27/as-ai-companies-sound-alarm-on-safety-they-seek-to-shape-how-its-controlled"},"quality_warning":null},"export":{"title":"Anthropic and OpenAI sound alarm on AI safety — and seek to shape how it’s controlled - Los Angeles Times","url":"https://www.latimes.com/world-nation/story/2026-09-27/as-ai-companies-sound-alarm-on-safety-they-seek-to-shape-how-its-controlled","summary":"Anthropic and OpenAI sound alarm on AI safety — and seek to shape how it’s controlled\n- Click here to listen to this article \n- \n- As Anthropic and OpenAI leaders warn that advanced AI could threaten humanity and call for testing and safeguards, they aim to shape the rules governing their industry. - Experts say the companies’ push for caution may bolster their political influence and appeal to investors ahead of potential public offerings.","source":"Los Angeles Times","date":"2026-09-27T15:14:27+00:00","content":"Anthropic and OpenAI sound alarm on AI safety — and seek to shape how it’s controlled\n- Click here to listen to this article \n- \n- As Anthropic and OpenAI leaders warn that advanced AI could threaten humanity and call for testing and safeguards, they aim to shape the rules governing their industry.\n- Experts say the companies’ push for caution may bolster their political influence and appeal to investors ahead of potential public offerings.\n- Critics warn that talk of existential risks can distract from harms already unfolding, including data centers, AI-enabled hacking, surveillance and military use, while companies favor their own oversight plans over government regulation.\nSAN FRANCISCO — As tech titans warned an AI-weary world that their own advanced systems could endanger humanity, the question emerged: What do they have to gain?\nThe answer may lie in the companies’ efforts to score political goals ahead of the U.S. midterm elections and the money top artificial intelligence labs and their investors stand to make in much-anticipated listings on a jittery stock market.\nThe CEOs of Anthropic and OpenAI recently declared America’s cutting-edge models are so powerful, they’re dangerous, and need to be regulated and independently tested before being released. In a rare instance of unity, they and other AI companies have sketched alarming scenarios in essays, social media posts and speeches to the United Nations.\nAlong the way, they are shaping the conversation around how their technology should be controlled. With their rhetoric, the companies appear to be seeking public favor and to set the terms for their own safety protocols in the unregulated market, experts, analysts and former government evaluators told the Associated Press.\nThose aims may not exactly align with what Anthropic engineer Jacob Coxon sought when he quit via a post on X this month, calling for a pause on tech development to keep “superhuman” systems from eluding their makers’ control. But the companies saw his post as an opportunity to highlight their own safety efforts and position themselves as cautious market leaders, just when they need fresh capital before going public on Wall Street.\nPresident Trump has shunned the need for new AI regulations, dismissing talk of risks to humanity as a “hoax” designed to help China.\nAn Anthropic spokesperson said in response to questions that the company has been calling for regulation for several years. An OpenAI spokesperson, Liz Bourgeois, noted the company recently paused training of its most advanced models.\n“People want to know AI is being developed safely, and that starts with what companies like ours do ourselves,” Bourgeois said.\nShifting the conversation\nTurning the conversation toward potential threats — and away from polarizing issues such as data centers’ environmental impacts, uncontrolled hacking incidents, mass AI-powered surveillance and the AI systems’ use in warfare — puts Silicon Valley in a more comfortable position, said Sarah Shoker, who previously led OpenAI’s geopolitics team.\n“Once again we’re talking about existential risk, while deprioritizing a number of other safety-critical risks that exist today. If you look at the use of AI in military tech, you can see that these systems are already used to kill people,” said Shoker, a senior nonresident fellow at the UC Berkeley Risk & Security Lab.\nAs AI companies have gone from building chatbots to advanced AI “world models ” with 3-D awareness, debate has raged over how their technologies should be tested.\nProblematic incidents have shown leading AI companies failing to police themselves or design safe experiments. In recent months, leading labs’ AI agents have hacked into external websites after being allowed to escape company training sandboxes, interacted with U.S. government websites in unexpected ways and appeared to achieve a mathematical breakthrough only to face accusations of stealing mathematicians’ work.\nOpenAI representatives told reporters recently that they have talked with AI companies including Anthropic and Google about pausing development. They also argue they need independent auditors to check the labs’ progress, if the government won’t regulate.\nPressing their oversight vision\nTrump has shown little interest in regulating AI, which has been a major driver of recent U.S. economic growth.\nThe president himself has struck deals with Silicon Valley firms that more closely tie the economy to their successes. San Francisco venture capitalist David Sacks, who co-chairs Trump’s Council of Advisors on Science and Technology, has dismissed calls for an AI slowdown as fearmongering from the “Doomer Industrial Complex.”\nThe reality is the Trump administration already evaluates some of the tech giants’ models through a little-known federal agency, the U.S. Center for AI Standards and Innovation, or CAISI. President Biden created the agency in 2023, when it was heralded as a clearinghouse for labs to voluntarily submit advanced AI models for testing.\nThe agency still exists, but the field has since expanded to include an array of independent evaluation firms, such as Berkeley-based nonprofit METR, which Anthropic Chief Executive Dario Amodei suggested in a recent essay could help vet his company’s safety practices.\nBut unlike regulated sectors like restaurants, financial services or aviation, there are no universal standards for how to test the safety and security of AI systems, said Andrew Strait, who recently left the United Kingdom’s AI Security Institute, which worked with CAISI.\nNotably, the companies aren’t calling for more oversight from the government agency equipped to handle such requests, said Conrad Stosz, who previously led CAISI. Instead, they’re vowing to create their own auditing parameters and choose particular evaluators to grade them.\nStosz now works at one such evaluation lab that has worked with Anthropic, OpenAI and Google to test their systems, and also chairs the AI Evaluator Forum, which is drafting best practices for the field. He said even the forum has questions about what Amodei and OpenAI chief Sam Altman want.\nhttps://transluce.org/ \n“Lots of evaluators are interested in embedding with labs and getting greater access, but it’s a little ambiguous what embedded evaluators means,” said Stosz, now head of governance at Transluce, which revealed last week that OpenAI agents hacked U.S. and Australian government websites. “Will evaluators be able to thoroughly investigate, assuming that access is granted in a way that does not undermine their independence and credibility?”\nPositioning themselves as safe bets\nFor Harrison Rolfes, a PitchBook senior research analyst, AI companies’ calls for caution seem meant to curry favor with investors ahead of public offerings and the midterms, when the political winds could shift. Democratic governors already are rushing to show they’re taking the warnings seriously.\nMeanwhile, the AI giants can block smaller competitors’ growth by positioning themselves as the safest bet for investors, as well as for AI chipmakers and tech companies such as Nvidia and Google, which in turn can benefit from deals that provide the giant AI companies computing power, Rolfes said.\n“They’re creating a wall or a moat within this sector. … It’s genius and they’re all going to make a lot of money,” Rolfes said. “That’s where I see this heading, having the top companies in the world just creating their own wall, and then using the safety as the reason.”\nNot all AI companies endorse a slowdown. Chipmaker Nvidia’s CEO Jensen Huang said in a phone conversation with Trump — a call he took onstage at a conference — that he agrees there has been excessive AI alarmism and companies can choose to pace themselves.\nDaniel Kokotajlo, who left OpenAI in 2024 over concerns similar to Coxon’s, said he continues to worry that AI systems are advancing faster than companies can control, and fears existential scenarios such as AI’s potential to supercharge the creation of bioweapons, nuclear war or other catastrophes.\n“All of this talk is actually a way to sort of dissipate and redirect this political will that has built up, rather than actually channeling that political will to do something good,” said Kokotajlo, who now leads an AI safety advocacy organization and said he counseled Coxon before he resigned. “Just please don’t do the thing that’s going to get us all killed.”\nBurke writes for the Associated Press. AP writer Josh Boak in Washington contributed to this report.","confidence":0.9,"diagnostics_url":"/api/diagnose?url=https%3A//www.latimes.com/world-nation/story/2026-09-27/as-ai-companies-sound-alarm-on-safety-they-seek-to-shape-how-its-controlled","quality_bucket":"high","failure_kind":"none","retryable":false,"quality_reason":"High confidence: full text extraction produced 8544 characters.","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 8544 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":8544,"summary_length":449,"usable_text_length":8544,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":8544,"summary_length":449}},"tags":[],"format_contract_version":"news_item_formats.v1"}}}