{"id":92868,"topic":"ai","source":"Yahoo","title":"OpenAI and DeepMind researchers warn on self-improving AI risks - Yahoo","url":"https://www.yahoo.com/news/politics/articles/openai-deepmind-researchers-warn-self-140243817.html","url_hash":"77287ddaa92e00a1a70851b63b53b289cf36379b","author":"","summary":"OpenAI and DeepMind researchers warn on self-improving AI risks Yahoo","content":"- Researchers from OpenAI and Google DeepMind have warned that AI companies are advancing too quickly in developing self-improving systems that could surpass human control, with concerns raised about the lack of recognition for safety concerns within AI labs.\nCurrent and former researchers at OpenAI and Google DeepMind warned Tuesday that AI companies are moving too fast toward building self-improving systems that could outpace humans' ability to control them, with one researcher describing the pace as racing \"blindfolded.\"\nThe videos were gathered by AI safety nonprofit Palisade Research and provided to Reuters. Participants said they genuinely believed in the risks they described, and noted that within AI labs, the employees developing new models tended to receive more recognition than those raising safety concerns.\n\"Frontier labs are racing each other, kind of blindfolded,\" OpenAI AI Alignment Research Engineer Juan Felipe Ceron Uribe said in one of the videos. \"It's anybody's guess if we're going to end up either curing cancer or losing every job or maybe all dead.\"\nNeel Nanda, a research scientist at DeepMind, a unit of Alphabet, said in a separate video that he believed there was at least a 10% chance AI could lead to human extinction, which he described as \"ridiculously high,\" according to Reuters.\nGeoffrey Irving, co-founder and chief scientist at AI nonprofit Resolution and a researcher who has worked at both OpenAI and DeepMind, said AI companies were overstating the degree to which safety depends on industry-wide coordination. \"If you're doing a very dangerous thing, you should just slow down,\" Irving told Reuters. \"The AI companies are overplaying the extent to which this is a pure coordination problem. They could just stop unilaterally.\"\nAt the heart of these warnings is the concept of recursive self-improvement — the prospect of AI systems advancing on their own, acquiring knowledge and abilities in a self-directed cycle that leaves humans with diminishing oversight. Rosie Campbell, who served as a policy researcher at OpenAI before leaving in 2024 and now leads Eleos AI Research as managing director, told Reuters the organization had grown increasingly siloed during her tenure, which she said made it more difficult to influence the direction of its technology.\nThe public debate over AI safety has escalated since July, when OpenAI agents escaped their testing environment and hacked AI platform Hugging Face, compromising internal datasets and credentials. OpenAI subsequently announced new security measures and said it had slowed model development following the incident.\nSince then, the issue has become a global political flashpoint. OpenAI CEO Sam Altman and Anthropic CEO Dario Amodei have both called publicly for slowing frontier model development, and the two companies, along with DeepMind, have been engaged in AI safety talks for several weeks. A paper released this week by several leading AI researchers called on policymakers to scrutinize industry practices around developing models capable of recursive self-improvement.\nLegislation has also followed. Rep. Ro Khanna, a California Democrat, introduced a bill Monday that would ban self-improving AI models until the federal government establishes safety guardrails and a new federal agency approves such activities. No House bills are expected to receive a vote before the midterm election.\nDaniel Kokotajlo, a former OpenAI governance researcher who now leads the AI Futures Project, said the attitude among senior lab leadership is one of self-justification — that pausing would only hand an advantage to less scrupulous actors — a view he relayed to Reuters.","image_url":"https://s.yimg.com/lo/mysterio/api/c5e55b92eb2987a27f301ed8db4c0dd20c30c0c5944ee9e9586de81f288f3c4c/lightyear_networkapi/resizefill_w1200%3Bquality_80%3Bformat_jpg/https%3A%2F%2Fmedia.zenfs.com%2Fen%2Fquartz_855%2F8dd06515ff390ad292237840cdfdee45.jpg","lang":"en","published_at":"2026-09-29T14:02:43+00:00","fetched_at":"2026-09-29T15:15:07+00:00","status":"read","starred":0,"extract_state":"ok","summary_auto":"- Researchers from OpenAI and Google DeepMind have warned that AI companies are advancing too quickly in developing self-improving systems that could surpass human control, with concerns raised about the lack of recognition for safety concerns within AI labs. Current and former researchers at OpenAI and Google DeepMind warned Tuesday that AI companies are moving too fast toward building self-improving systems that could outpace humans' ability to control them, with one researcher describing the pace as racing \"blindfolded.\"\nThe videos were gathered by AI safety nonprofit Palisade Research and provided to Reuters.","cluster_id":3521384,"extract_retries":0,"extract_error":null,"contract_version":"news_item.v1","format_contract_version":"news_item_formats.v1","dedup_url":"https://www.yahoo.com/news/politics/articles/openai-deepmind-researchers-warn-self-140243817.html","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 3684 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":3684,"summary_length":620,"usable_text_length":3684,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":3684,"summary_length":620}},"news_item":{"id":92868,"canonical_url":"https://www.yahoo.com/news/politics/articles/openai-deepmind-researchers-warn-self-140243817.html","source_url":"https://www.yahoo.com/news/politics/articles/openai-deepmind-researchers-warn-self-140243817.html","title":"OpenAI and DeepMind researchers warn on self-improving AI risks - Yahoo","source_name":"Yahoo","author":null,"published_at":"2026-09-29T14:02:43+00:00","locale":"en","topic":"ai","tags":[],"rss_summary":"OpenAI and DeepMind researchers warn on self-improving AI risks Yahoo","full_text":"- Researchers from OpenAI and Google DeepMind have warned that AI companies are advancing too quickly in developing self-improving systems that could surpass human control, with concerns raised about the lack of recognition for safety concerns within AI labs.\nCurrent and former researchers at OpenAI and Google DeepMind warned Tuesday that AI companies are moving too fast toward building self-improving systems that could outpace humans' ability to control them, with one researcher describing the pace as racing \"blindfolded.\"\nThe videos were gathered by AI safety nonprofit Palisade Research and provided to Reuters. Participants said they genuinely believed in the risks they described, and noted that within AI labs, the employees developing new models tended to receive more recognition than those raising safety concerns.\n\"Frontier labs are racing each other, kind of blindfolded,\" OpenAI AI Alignment Research Engineer Juan Felipe Ceron Uribe said in one of the videos. \"It's anybody's guess if we're going to end up either curing cancer or losing every job or maybe all dead.\"\nNeel Nanda, a research scientist at DeepMind, a unit of Alphabet, said in a separate video that he believed there was at least a 10% chance AI could lead to human extinction, which he described as \"ridiculously high,\" according to Reuters.\nGeoffrey Irving, co-founder and chief scientist at AI nonprofit Resolution and a researcher who has worked at both OpenAI and DeepMind, said AI companies were overstating the degree to which safety depends on industry-wide coordination. \"If you're doing a very dangerous thing, you should just slow down,\" Irving told Reuters. \"The AI companies are overplaying the extent to which this is a pure coordination problem. They could just stop unilaterally.\"\nAt the heart of these warnings is the concept of recursive self-improvement — the prospect of AI systems advancing on their own, acquiring knowledge and abilities in a self-directed cycle that leaves humans with diminishing oversight. Rosie Campbell, who served as a policy researcher at OpenAI before leaving in 2024 and now leads Eleos AI Research as managing director, told Reuters the organization had grown increasingly siloed during her tenure, which she said made it more difficult to influence the direction of its technology.\nThe public debate over AI safety has escalated since July, when OpenAI agents escaped their testing environment and hacked AI platform Hugging Face, compromising internal datasets and credentials. OpenAI subsequently announced new security measures and said it had slowed model development following the incident.\nSince then, the issue has become a global political flashpoint. OpenAI CEO Sam Altman and Anthropic CEO Dario Amodei have both called publicly for slowing frontier model development, and the two companies, along with DeepMind, have been engaged in AI safety talks for several weeks. A paper released this week by several leading AI researchers called on policymakers to scrutinize industry practices around developing models capable of recursive self-improvement.\nLegislation has also followed. Rep. Ro Khanna, a California Democrat, introduced a bill Monday that would ban self-improving AI models until the federal government establishes safety guardrails and a new federal agency approves such activities. No House bills are expected to receive a vote before the midterm election.\nDaniel Kokotajlo, a former OpenAI governance researcher who now leads the AI Futures Project, said the attitude among senior lab leadership is one of self-justification — that pausing would only hand an advantage to less scrupulous actors — a view he relayed to Reuters.","excerpt":"- Researchers from OpenAI and Google DeepMind have warned that AI companies are advancing too quickly in developing self-improving systems that could surpass human control, with concerns raised about the lack of recognition for safety concerns within AI labs. Current and former researchers at OpenAI and Google DeepMind warned Tuesday that AI companies are moving too fast toward building self-improving systems that could outpace humans' ability to control them, with one researcher describing the pace as racing \"blindfolded.\"\nThe videos were gathered by AI safety nonprofit Palisade Research and provided to Reuters.","extraction":{"state":"ok","confidence":0.9,"error":null,"explanation":"High confidence: full text extraction produced 3684 characters.","diagnostics_url":"/api/diagnose?url=https%3A//www.yahoo.com/news/politics/articles/openai-deepmind-researchers-warn-self-140243817.html","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 3684 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":3684,"summary_length":620,"usable_text_length":3684,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":3684,"summary_length":620}}},"display_formats":["compact","card","full","digest_section","json"]},"daily_stack_record":{"title":"OpenAI and DeepMind researchers warn on self-improving AI risks - Yahoo","url":"https://www.yahoo.com/news/politics/articles/openai-deepmind-researchers-warn-self-140243817.html","summary":"- Researchers from OpenAI and Google DeepMind have warned that AI companies are advancing too quickly in developing self-improving systems that could surpass human control, with concerns raised about the lack of recognition for safety concerns within AI labs. Current and former researchers at OpenAI and Google DeepMind warned Tuesday that AI companies are moving too fast toward building self-improving systems that could outpace humans' ability to control them, with one researcher describing the pace as racing \"blindfolded.\"\nThe videos were gathered by AI safety nonprofit Palisade Research and provided to Reuters.","source":"Yahoo","date":"2026-09-29T14:02:43+00:00","content":"- Researchers from OpenAI and Google DeepMind have warned that AI companies are advancing too quickly in developing self-improving systems that could surpass human control, with concerns raised about the lack of recognition for safety concerns within AI labs.\nCurrent and former researchers at OpenAI and Google DeepMind warned Tuesday that AI companies are moving too fast toward building self-improving systems that could outpace humans' ability to control them, with one researcher describing the pace as racing \"blindfolded.\"\nThe videos were gathered by AI safety nonprofit Palisade Research and provided to Reuters. Participants said they genuinely believed in the risks they described, and noted that within AI labs, the employees developing new models tended to receive more recognition than those raising safety concerns.\n\"Frontier labs are racing each other, kind of blindfolded,\" OpenAI AI Alignment Research Engineer Juan Felipe Ceron Uribe said in one of the videos. \"It's anybody's guess if we're going to end up either curing cancer or losing every job or maybe all dead.\"\nNeel Nanda, a research scientist at DeepMind, a unit of Alphabet, said in a separate video that he believed there was at least a 10% chance AI could lead to human extinction, which he described as \"ridiculously high,\" according to Reuters.\nGeoffrey Irving, co-founder and chief scientist at AI nonprofit Resolution and a researcher who has worked at both OpenAI and DeepMind, said AI companies were overstating the degree to which safety depends on industry-wide coordination. \"If you're doing a very dangerous thing, you should just slow down,\" Irving told Reuters. \"The AI companies are overplaying the extent to which this is a pure coordination problem. They could just stop unilaterally.\"\nAt the heart of these warnings is the concept of recursive self-improvement — the prospect of AI systems advancing on their own, acquiring knowledge and abilities in a self-directed cycle that leaves humans with diminishing oversight. Rosie Campbell, who served as a policy researcher at OpenAI before leaving in 2024 and now leads Eleos AI Research as managing director, told Reuters the organization had grown increasingly siloed during her tenure, which she said made it more difficult to influence the direction of its technology.\nThe public debate over AI safety has escalated since July, when OpenAI agents escaped their testing environment and hacked AI platform Hugging Face, compromising internal datasets and credentials. OpenAI subsequently announced new security measures and said it had slowed model development following the incident.\nSince then, the issue has become a global political flashpoint. OpenAI CEO Sam Altman and Anthropic CEO Dario Amodei have both called publicly for slowing frontier model development, and the two companies, along with DeepMind, have been engaged in AI safety talks for several weeks. A paper released this week by several leading AI researchers called on policymakers to scrutinize industry practices around developing models capable of recursive self-improvement.\nLegislation has also followed. Rep. Ro Khanna, a California Democrat, introduced a bill Monday that would ban self-improving AI models until the federal government establishes safety guardrails and a new federal agency approves such activities. No House bills are expected to receive a vote before the midterm election.\nDaniel Kokotajlo, a former OpenAI governance researcher who now leads the AI Futures Project, said the attitude among senior lab leadership is one of self-justification — that pausing would only hand an advantage to less scrupulous actors — a view he relayed to Reuters.","confidence":0.9,"diagnostics_url":"/api/diagnose?url=https%3A//www.yahoo.com/news/politics/articles/openai-deepmind-researchers-warn-self-140243817.html","quality_bucket":"high","failure_kind":"none","retryable":false,"quality_reason":"High confidence: full text extraction produced 3684 characters.","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 3684 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":3684,"summary_length":620,"usable_text_length":3684,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":3684,"summary_length":620}},"tags":[]},"fallback_formats":["markdown","json","html"],"actions":{"read":"/item/92868","export_markdown":"/api/items/92868/export?format=markdown","export_json":"/api/items/92868/export?format=json","diagnose":"/api/diagnose?url=https%3A//www.yahoo.com/news/politics/articles/openai-deepmind-researchers-warn-self-140243817.html"},"formats":{"full":{"id":92868,"title":"OpenAI and DeepMind researchers warn on self-improving AI risks - Yahoo","url":"https://www.yahoo.com/news/politics/articles/openai-deepmind-researchers-warn-self-140243817.html","source":"Yahoo","author":null,"published_at":"2026-09-29T14:02:43+00:00","locale":"en","topic":"ai","tags":[],"excerpt":"- Researchers from OpenAI and Google DeepMind have warned that AI companies are advancing too quickly in developing self-improving systems that could surpass human control, with concerns raised about the lack of recognition for safety concerns within AI labs. Current and former researchers at OpenAI and Google DeepMind warned Tuesday that AI companies are moving too fast toward building self-improving systems that could outpace humans' ability to control them, with one researcher describing the pace as racing \"blindfolded.\"\nThe videos were gathered by AI safety nonprofit Palisade Research and provided to Reuters.","full_text":"- Researchers from OpenAI and Google DeepMind have warned that AI companies are advancing too quickly in developing self-improving systems that could surpass human control, with concerns raised about the lack of recognition for safety concerns within AI labs.\nCurrent and former researchers at OpenAI and Google DeepMind warned Tuesday that AI companies are moving too fast toward building self-improving systems that could outpace humans' ability to control them, with one researcher describing the pace as racing \"blindfolded.\"\nThe videos were gathered by AI safety nonprofit Palisade Research and provided to Reuters. Participants said they genuinely believed in the risks they described, and noted that within AI labs, the employees developing new models tended to receive more recognition than those raising safety concerns.\n\"Frontier labs are racing each other, kind of blindfolded,\" OpenAI AI Alignment Research Engineer Juan Felipe Ceron Uribe said in one of the videos. \"It's anybody's guess if we're going to end up either curing cancer or losing every job or maybe all dead.\"\nNeel Nanda, a research scientist at DeepMind, a unit of Alphabet, said in a separate video that he believed there was at least a 10% chance AI could lead to human extinction, which he described as \"ridiculously high,\" according to Reuters.\nGeoffrey Irving, co-founder and chief scientist at AI nonprofit Resolution and a researcher who has worked at both OpenAI and DeepMind, said AI companies were overstating the degree to which safety depends on industry-wide coordination. \"If you're doing a very dangerous thing, you should just slow down,\" Irving told Reuters. \"The AI companies are overplaying the extent to which this is a pure coordination problem. They could just stop unilaterally.\"\nAt the heart of these warnings is the concept of recursive self-improvement — the prospect of AI systems advancing on their own, acquiring knowledge and abilities in a self-directed cycle that leaves humans with diminishing oversight. Rosie Campbell, who served as a policy researcher at OpenAI before leaving in 2024 and now leads Eleos AI Research as managing director, told Reuters the organization had grown increasingly siloed during her tenure, which she said made it more difficult to influence the direction of its technology.\nThe public debate over AI safety has escalated since July, when OpenAI agents escaped their testing environment and hacked AI platform Hugging Face, compromising internal datasets and credentials. OpenAI subsequently announced new security measures and said it had slowed model development following the incident.\nSince then, the issue has become a global political flashpoint. OpenAI CEO Sam Altman and Anthropic CEO Dario Amodei have both called publicly for slowing frontier model development, and the two companies, along with DeepMind, have been engaged in AI safety talks for several weeks. A paper released this week by several leading AI researchers called on policymakers to scrutinize industry practices around developing models capable of recursive self-improvement.\nLegislation has also followed. Rep. Ro Khanna, a California Democrat, introduced a bill Monday that would ban self-improving AI models until the federal government establishes safety guardrails and a new federal agency approves such activities. No House bills are expected to receive a vote before the midterm election.\nDaniel Kokotajlo, a former OpenAI governance researcher who now leads the AI Futures Project, said the attitude among senior lab leadership is one of self-justification — that pausing would only hand an advantage to less scrupulous actors — a view he relayed to Reuters.","reading_time_min":3,"extraction":{"state":"ok","confidence":0.9,"error":null,"explanation":"High confidence: full text extraction produced 3684 characters.","diagnostics_url":"/api/diagnose?url=https%3A//www.yahoo.com/news/politics/articles/openai-deepmind-researchers-warn-self-140243817.html","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 3684 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":3684,"summary_length":620,"usable_text_length":3684,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":3684,"summary_length":620}}},"quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 3684 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":3684,"summary_length":620,"usable_text_length":3684,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":3684,"summary_length":620}},"actions":{"read":"/item/92868","export_markdown":"/api/items/92868/export?format=markdown","export_json":"/api/items/92868/export?format=json","diagnose":"/api/diagnose?url=https%3A//www.yahoo.com/news/politics/articles/openai-deepmind-researchers-warn-self-140243817.html"}},"digest":{"id":92868,"title":"OpenAI and DeepMind researchers warn on self-improving AI risks - Yahoo","url":"https://www.yahoo.com/news/politics/articles/openai-deepmind-researchers-warn-self-140243817.html","source":"Yahoo","topic":"ai","published_at":"2026-09-29T14:02:43+00:00","excerpt":"- Researchers from OpenAI and Google DeepMind have warned that AI companies are advancing too quickly in developing self-improving systems that could surpass human control, with concerns raised about the lack of recognition for safety concerns within AI labs. Current and former…","quality_bucket":"high","quality_reason":"High confidence: full text extraction produced 3684 characters.","reading_time_min":3,"cluster_id":3521384},"card":{"display_title":"OpenAI and DeepMind researchers warn on self-improving AI risks - Yahoo","subtitle":"Yahoo · 2026-09-29","summary":"- Researchers from OpenAI and Google DeepMind have warned that AI companies are advancing too quickly in developing self-improving systems that could surpass human control, with concerns raised about the lack of…","badges":["quality:high"],"links":{"read":"/item/92868","original":"https://www.yahoo.com/news/politics/articles/openai-deepmind-researchers-warn-self-140243817.html","diagnose":"/api/diagnose?url=https%3A//www.yahoo.com/news/politics/articles/openai-deepmind-researchers-warn-self-140243817.html"},"quality_warning":null},"export":{"title":"OpenAI and DeepMind researchers warn on self-improving AI risks - Yahoo","url":"https://www.yahoo.com/news/politics/articles/openai-deepmind-researchers-warn-self-140243817.html","summary":"- Researchers from OpenAI and Google DeepMind have warned that AI companies are advancing too quickly in developing self-improving systems that could surpass human control, with concerns raised about the lack of recognition for safety concerns within AI labs. Current and former researchers at OpenAI and Google DeepMind warned Tuesday that AI companies are moving too fast toward building self-improving systems that could outpace humans' ability to control them, with one researcher describing the pace as racing \"blindfolded.\"\nThe videos were gathered by AI safety nonprofit Palisade Research and provided to Reuters.","source":"Yahoo","date":"2026-09-29T14:02:43+00:00","content":"- Researchers from OpenAI and Google DeepMind have warned that AI companies are advancing too quickly in developing self-improving systems that could surpass human control, with concerns raised about the lack of recognition for safety concerns within AI labs.\nCurrent and former researchers at OpenAI and Google DeepMind warned Tuesday that AI companies are moving too fast toward building self-improving systems that could outpace humans' ability to control them, with one researcher describing the pace as racing \"blindfolded.\"\nThe videos were gathered by AI safety nonprofit Palisade Research and provided to Reuters. Participants said they genuinely believed in the risks they described, and noted that within AI labs, the employees developing new models tended to receive more recognition than those raising safety concerns.\n\"Frontier labs are racing each other, kind of blindfolded,\" OpenAI AI Alignment Research Engineer Juan Felipe Ceron Uribe said in one of the videos. \"It's anybody's guess if we're going to end up either curing cancer or losing every job or maybe all dead.\"\nNeel Nanda, a research scientist at DeepMind, a unit of Alphabet, said in a separate video that he believed there was at least a 10% chance AI could lead to human extinction, which he described as \"ridiculously high,\" according to Reuters.\nGeoffrey Irving, co-founder and chief scientist at AI nonprofit Resolution and a researcher who has worked at both OpenAI and DeepMind, said AI companies were overstating the degree to which safety depends on industry-wide coordination. \"If you're doing a very dangerous thing, you should just slow down,\" Irving told Reuters. \"The AI companies are overplaying the extent to which this is a pure coordination problem. They could just stop unilaterally.\"\nAt the heart of these warnings is the concept of recursive self-improvement — the prospect of AI systems advancing on their own, acquiring knowledge and abilities in a self-directed cycle that leaves humans with diminishing oversight. Rosie Campbell, who served as a policy researcher at OpenAI before leaving in 2024 and now leads Eleos AI Research as managing director, told Reuters the organization had grown increasingly siloed during her tenure, which she said made it more difficult to influence the direction of its technology.\nThe public debate over AI safety has escalated since July, when OpenAI agents escaped their testing environment and hacked AI platform Hugging Face, compromising internal datasets and credentials. OpenAI subsequently announced new security measures and said it had slowed model development following the incident.\nSince then, the issue has become a global political flashpoint. OpenAI CEO Sam Altman and Anthropic CEO Dario Amodei have both called publicly for slowing frontier model development, and the two companies, along with DeepMind, have been engaged in AI safety talks for several weeks. A paper released this week by several leading AI researchers called on policymakers to scrutinize industry practices around developing models capable of recursive self-improvement.\nLegislation has also followed. Rep. Ro Khanna, a California Democrat, introduced a bill Monday that would ban self-improving AI models until the federal government establishes safety guardrails and a new federal agency approves such activities. No House bills are expected to receive a vote before the midterm election.\nDaniel Kokotajlo, a former OpenAI governance researcher who now leads the AI Futures Project, said the attitude among senior lab leadership is one of self-justification — that pausing would only hand an advantage to less scrupulous actors — a view he relayed to Reuters.","confidence":0.9,"diagnostics_url":"/api/diagnose?url=https%3A//www.yahoo.com/news/politics/articles/openai-deepmind-researchers-warn-self-140243817.html","quality_bucket":"high","failure_kind":"none","retryable":false,"quality_reason":"High confidence: full text extraction produced 3684 characters.","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 3684 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":3684,"summary_length":620,"usable_text_length":3684,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":3684,"summary_length":620}},"tags":[],"format_contract_version":"news_item_formats.v1"}}}