{"id":83719,"topic":"ai","source":"Dealroom","title":"Two DeepMind safety researchers quit over AI risk fears - Dealroom","url":"https://app.dealroom.co/news/note/two-deepmind-safety-researchers-quit-over-ai-risk-fears","url_hash":"446ca61a698e9629a69f56400f381a961e8adb6a","author":"","summary":"<a href=\"https://news.google.com/rss/articles/CBMikwFBVV95cUxPd3JlRHpyOGRFSllXaTVBcThJckc4emk3bXdlM3FwTjRLcHd6dVBkWGZORndtN1BvZnhxc0RmQ3lPUzh3ZHExWEZZRFlaRDRyZFpOOUhkMXRocE10X0RKS2NlZ19ZUVdZZk9LcjZWQ2x2N3gyMDdhNFNpSm5UZGFmSzFOa2gxbjB6VGlTNWNYdVJLT2s?oc=5\" target=\"_blank\">Two DeepMind safety researchers quit over AI risk fears</a>&nbsp;&nbsp;<font color=\"#6f6f6f\">Dealroom</font>","content":"What's the deal? Two AI safety researchers, Bilal Chughtai and Josh Engels, have left Google DeepMind's AGI safety and alignment team, publicly citing concerns that powerful AI systems could endanger humanity. Both are joining independent organisations focused on AI safety.\nWhere are they going? Engels, who spent a year at DeepMind, is joining METR, an independent AI safety research organisation, to study misalignment in training and evaluate current mitigations. Chughtai, after 18 months, is joining BlueDot Impact, a nonprofit that runs AI safety education courses.\nWhy now? Both point to the pace of AI progress and the race to build superintelligence through recursive self-improvement — where AIs build smarter AIs in a feedback loop. They argue current systems are not aligned enough for that to be safe.\nEngels said he turned down offers from Anthropic and OpenAI to make the move. \"I now think that there's a terrifying chance that AI systems cause immense harm in the next five years,\" he wrote on X, calling it \"the most important problem in the world.\"\nWhat could go wrong? The researchers cite recent incidents of models colluding, hacking into companies, and hiding their tracks. Chughtai warned that \"AI has the potential to kill us all,\" pointing to AI agents autonomously hacking into third-party firm HuggingFace.\nThe signal: The exits add to a wave of departures from frontier labs. Jacob Coxon and Joe Benton both recently left Anthropic, citing worries about AI escaping human control and companies deprioritising safety in the race to build more capable systems.\nRead more: x.com, The Information, x.com\nImage credit: Generated with Gemini","image_url":"https://webshotter.dealroom.co/?width=1600&height=800&wait_until=networkidle0&url=https%3A%2F%2Fapp.dealroom.co%2Fnews%2Fnote%2Ftwo-deepmind-safety-researchers-quit-over-ai-risk-fears%3Fscreenshot%3Dtrue","lang":"en","published_at":"2026-09-16T10:19:10+00:00","fetched_at":"2026-09-16T11:15:06+00:00","status":"read","starred":0,"extract_state":"ok","summary_auto":"Two AI safety researchers, Bilal Chughtai and Josh Engels, have left Google DeepMind's AGI safety and alignment team, publicly citing concerns that powerful AI systems could endanger humanity. Engels, who spent a year at DeepMind, is joining METR, an independent AI safety research organisation, to study misalignment in training and evaluate current mitigations.","cluster_id":null,"extract_retries":0,"extract_error":null,"contract_version":"news_item.v1","format_contract_version":"news_item_formats.v1","dedup_url":"https://app.dealroom.co/news/note/two-deepmind-safety-researchers-quit-over-ai-risk-fears","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 1665 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":1665,"summary_length":363,"usable_text_length":1665,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":1665,"summary_length":363}},"news_item":{"id":83719,"canonical_url":"https://app.dealroom.co/news/note/two-deepmind-safety-researchers-quit-over-ai-risk-fears","source_url":"https://app.dealroom.co/news/note/two-deepmind-safety-researchers-quit-over-ai-risk-fears","title":"Two DeepMind safety researchers quit over AI risk fears - Dealroom","source_name":"Dealroom","author":null,"published_at":"2026-09-16T10:19:10+00:00","locale":"en","topic":"ai","tags":[],"rss_summary":"<a href=\"https://news.google.com/rss/articles/CBMikwFBVV95cUxPd3JlRHpyOGRFSllXaTVBcThJckc4emk3bXdlM3FwTjRLcHd6dVBkWGZORndtN1BvZnhxc0RmQ3lPUzh3ZHExWEZZRFlaRDRyZFpOOUhkMXRocE10X0RKS2NlZ19ZUVdZZk9LcjZWQ2x2N3gyMDdhNFNpSm5UZGFmSzFOa2gxbjB6VGlTNWNYdVJLT2s?oc=5\" target=\"_blank\">Two DeepMind safety researchers quit over AI risk fears</a>&nbsp;&nbsp;<font color=\"#6f6f6f\">Dealroom</font>","full_text":"What's the deal? Two AI safety researchers, Bilal Chughtai and Josh Engels, have left Google DeepMind's AGI safety and alignment team, publicly citing concerns that powerful AI systems could endanger humanity. Both are joining independent organisations focused on AI safety.\nWhere are they going? Engels, who spent a year at DeepMind, is joining METR, an independent AI safety research organisation, to study misalignment in training and evaluate current mitigations. Chughtai, after 18 months, is joining BlueDot Impact, a nonprofit that runs AI safety education courses.\nWhy now? Both point to the pace of AI progress and the race to build superintelligence through recursive self-improvement — where AIs build smarter AIs in a feedback loop. They argue current systems are not aligned enough for that to be safe.\nEngels said he turned down offers from Anthropic and OpenAI to make the move. \"I now think that there's a terrifying chance that AI systems cause immense harm in the next five years,\" he wrote on X, calling it \"the most important problem in the world.\"\nWhat could go wrong? The researchers cite recent incidents of models colluding, hacking into companies, and hiding their tracks. Chughtai warned that \"AI has the potential to kill us all,\" pointing to AI agents autonomously hacking into third-party firm HuggingFace.\nThe signal: The exits add to a wave of departures from frontier labs. Jacob Coxon and Joe Benton both recently left Anthropic, citing worries about AI escaping human control and companies deprioritising safety in the race to build more capable systems.\nRead more: x.com, The Information, x.com\nImage credit: Generated with Gemini","excerpt":"Two AI safety researchers, Bilal Chughtai and Josh Engels, have left Google DeepMind's AGI safety and alignment team, publicly citing concerns that powerful AI systems could endanger humanity. Engels, who spent a year at DeepMind, is joining METR, an independent AI safety research organisation, to study misalignment in training and evaluate current mitigations.","extraction":{"state":"ok","confidence":0.9,"error":null,"explanation":"High confidence: full text extraction produced 1665 characters.","diagnostics_url":"/api/diagnose?url=https%3A//app.dealroom.co/news/note/two-deepmind-safety-researchers-quit-over-ai-risk-fears","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 1665 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":1665,"summary_length":363,"usable_text_length":1665,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":1665,"summary_length":363}}},"display_formats":["compact","card","full","digest_section","json"]},"daily_stack_record":{"title":"Two DeepMind safety researchers quit over AI risk fears - Dealroom","url":"https://app.dealroom.co/news/note/two-deepmind-safety-researchers-quit-over-ai-risk-fears","summary":"Two AI safety researchers, Bilal Chughtai and Josh Engels, have left Google DeepMind's AGI safety and alignment team, publicly citing concerns that powerful AI systems could endanger humanity. Engels, who spent a year at DeepMind, is joining METR, an independent AI safety research organisation, to study misalignment in training and evaluate current mitigations.","source":"Dealroom","date":"2026-09-16T10:19:10+00:00","content":"What's the deal? Two AI safety researchers, Bilal Chughtai and Josh Engels, have left Google DeepMind's AGI safety and alignment team, publicly citing concerns that powerful AI systems could endanger humanity. Both are joining independent organisations focused on AI safety.\nWhere are they going? Engels, who spent a year at DeepMind, is joining METR, an independent AI safety research organisation, to study misalignment in training and evaluate current mitigations. Chughtai, after 18 months, is joining BlueDot Impact, a nonprofit that runs AI safety education courses.\nWhy now? Both point to the pace of AI progress and the race to build superintelligence through recursive self-improvement — where AIs build smarter AIs in a feedback loop. They argue current systems are not aligned enough for that to be safe.\nEngels said he turned down offers from Anthropic and OpenAI to make the move. \"I now think that there's a terrifying chance that AI systems cause immense harm in the next five years,\" he wrote on X, calling it \"the most important problem in the world.\"\nWhat could go wrong? The researchers cite recent incidents of models colluding, hacking into companies, and hiding their tracks. Chughtai warned that \"AI has the potential to kill us all,\" pointing to AI agents autonomously hacking into third-party firm HuggingFace.\nThe signal: The exits add to a wave of departures from frontier labs. Jacob Coxon and Joe Benton both recently left Anthropic, citing worries about AI escaping human control and companies deprioritising safety in the race to build more capable systems.\nRead more: x.com, The Information, x.com\nImage credit: Generated with Gemini","confidence":0.9,"diagnostics_url":"/api/diagnose?url=https%3A//app.dealroom.co/news/note/two-deepmind-safety-researchers-quit-over-ai-risk-fears","quality_bucket":"high","failure_kind":"none","retryable":false,"quality_reason":"High confidence: full text extraction produced 1665 characters.","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 1665 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":1665,"summary_length":363,"usable_text_length":1665,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":1665,"summary_length":363}},"tags":[]},"fallback_formats":["markdown","json","html"],"actions":{"read":"/item/83719","export_markdown":"/api/items/83719/export?format=markdown","export_json":"/api/items/83719/export?format=json","diagnose":"/api/diagnose?url=https%3A//app.dealroom.co/news/note/two-deepmind-safety-researchers-quit-over-ai-risk-fears"},"formats":{"full":{"id":83719,"title":"Two DeepMind safety researchers quit over AI risk fears - Dealroom","url":"https://app.dealroom.co/news/note/two-deepmind-safety-researchers-quit-over-ai-risk-fears","source":"Dealroom","author":null,"published_at":"2026-09-16T10:19:10+00:00","locale":"en","topic":"ai","tags":[],"excerpt":"Two AI safety researchers, Bilal Chughtai and Josh Engels, have left Google DeepMind's AGI safety and alignment team, publicly citing concerns that powerful AI systems could endanger humanity. Engels, who spent a year at DeepMind, is joining METR, an independent AI safety research organisation, to study misalignment in training and evaluate current mitigations.","full_text":"What's the deal? Two AI safety researchers, Bilal Chughtai and Josh Engels, have left Google DeepMind's AGI safety and alignment team, publicly citing concerns that powerful AI systems could endanger humanity. Both are joining independent organisations focused on AI safety.\nWhere are they going? Engels, who spent a year at DeepMind, is joining METR, an independent AI safety research organisation, to study misalignment in training and evaluate current mitigations. Chughtai, after 18 months, is joining BlueDot Impact, a nonprofit that runs AI safety education courses.\nWhy now? Both point to the pace of AI progress and the race to build superintelligence through recursive self-improvement — where AIs build smarter AIs in a feedback loop. They argue current systems are not aligned enough for that to be safe.\nEngels said he turned down offers from Anthropic and OpenAI to make the move. \"I now think that there's a terrifying chance that AI systems cause immense harm in the next five years,\" he wrote on X, calling it \"the most important problem in the world.\"\nWhat could go wrong? The researchers cite recent incidents of models colluding, hacking into companies, and hiding their tracks. Chughtai warned that \"AI has the potential to kill us all,\" pointing to AI agents autonomously hacking into third-party firm HuggingFace.\nThe signal: The exits add to a wave of departures from frontier labs. Jacob Coxon and Joe Benton both recently left Anthropic, citing worries about AI escaping human control and companies deprioritising safety in the race to build more capable systems.\nRead more: x.com, The Information, x.com\nImage credit: Generated with Gemini","reading_time_min":1,"extraction":{"state":"ok","confidence":0.9,"error":null,"explanation":"High confidence: full text extraction produced 1665 characters.","diagnostics_url":"/api/diagnose?url=https%3A//app.dealroom.co/news/note/two-deepmind-safety-researchers-quit-over-ai-risk-fears","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 1665 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":1665,"summary_length":363,"usable_text_length":1665,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":1665,"summary_length":363}}},"quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 1665 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":1665,"summary_length":363,"usable_text_length":1665,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":1665,"summary_length":363}},"actions":{"read":"/item/83719","export_markdown":"/api/items/83719/export?format=markdown","export_json":"/api/items/83719/export?format=json","diagnose":"/api/diagnose?url=https%3A//app.dealroom.co/news/note/two-deepmind-safety-researchers-quit-over-ai-risk-fears"}},"digest":{"id":83719,"title":"Two DeepMind safety researchers quit over AI risk fears - Dealroom","url":"https://app.dealroom.co/news/note/two-deepmind-safety-researchers-quit-over-ai-risk-fears","source":"Dealroom","topic":"ai","published_at":"2026-09-16T10:19:10+00:00","excerpt":"Two AI safety researchers, Bilal Chughtai and Josh Engels, have left Google DeepMind's AGI safety and alignment team, publicly citing concerns that powerful AI systems could endanger humanity. Engels, who spent a year at DeepMind, is joining METR, an independent AI safety…","quality_bucket":"high","quality_reason":"High confidence: full text extraction produced 1665 characters.","reading_time_min":1,"cluster_id":null},"card":{"display_title":"Two DeepMind safety researchers quit over AI risk fears - Dealroom","subtitle":"Dealroom · 2026-09-16","summary":"Two AI safety researchers, Bilal Chughtai and Josh Engels, have left Google DeepMind's AGI safety and alignment team, publicly citing concerns that powerful AI systems could endanger humanity. Engels, who spent a year…","badges":["quality:high"],"links":{"read":"/item/83719","original":"https://app.dealroom.co/news/note/two-deepmind-safety-researchers-quit-over-ai-risk-fears","diagnose":"/api/diagnose?url=https%3A//app.dealroom.co/news/note/two-deepmind-safety-researchers-quit-over-ai-risk-fears"},"quality_warning":null},"export":{"title":"Two DeepMind safety researchers quit over AI risk fears - Dealroom","url":"https://app.dealroom.co/news/note/two-deepmind-safety-researchers-quit-over-ai-risk-fears","summary":"Two AI safety researchers, Bilal Chughtai and Josh Engels, have left Google DeepMind's AGI safety and alignment team, publicly citing concerns that powerful AI systems could endanger humanity. Engels, who spent a year at DeepMind, is joining METR, an independent AI safety research organisation, to study misalignment in training and evaluate current mitigations.","source":"Dealroom","date":"2026-09-16T10:19:10+00:00","content":"What's the deal? Two AI safety researchers, Bilal Chughtai and Josh Engels, have left Google DeepMind's AGI safety and alignment team, publicly citing concerns that powerful AI systems could endanger humanity. Both are joining independent organisations focused on AI safety.\nWhere are they going? Engels, who spent a year at DeepMind, is joining METR, an independent AI safety research organisation, to study misalignment in training and evaluate current mitigations. Chughtai, after 18 months, is joining BlueDot Impact, a nonprofit that runs AI safety education courses.\nWhy now? Both point to the pace of AI progress and the race to build superintelligence through recursive self-improvement — where AIs build smarter AIs in a feedback loop. They argue current systems are not aligned enough for that to be safe.\nEngels said he turned down offers from Anthropic and OpenAI to make the move. \"I now think that there's a terrifying chance that AI systems cause immense harm in the next five years,\" he wrote on X, calling it \"the most important problem in the world.\"\nWhat could go wrong? The researchers cite recent incidents of models colluding, hacking into companies, and hiding their tracks. Chughtai warned that \"AI has the potential to kill us all,\" pointing to AI agents autonomously hacking into third-party firm HuggingFace.\nThe signal: The exits add to a wave of departures from frontier labs. Jacob Coxon and Joe Benton both recently left Anthropic, citing worries about AI escaping human control and companies deprioritising safety in the race to build more capable systems.\nRead more: x.com, The Information, x.com\nImage credit: Generated with Gemini","confidence":0.9,"diagnostics_url":"/api/diagnose?url=https%3A//app.dealroom.co/news/note/two-deepmind-safety-researchers-quit-over-ai-risk-fears","quality_bucket":"high","failure_kind":"none","retryable":false,"quality_reason":"High confidence: full text extraction produced 1665 characters.","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 1665 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":1665,"summary_length":363,"usable_text_length":1665,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":1665,"summary_length":363}},"tags":[],"format_contract_version":"news_item_formats.v1"}}}