{"id":82652,"topic":"ai","source":"business-standard.com","title":"Google DeepMind researcher quits, says AI may cause 'immense harm' in 5 yrs - business-standard.com","url":"https://www.business-standard.com/technology/artificial-intelligence/google-deepmind-researcher-quits-says-ai-may-cause-immense-harm-in-5-yrs-126091500347_1.html","url_hash":"573de72696b50fd2eb738c8f648d6d36bef1ab98","author":"","summary":"Google DeepMind researcher quits, says AI may cause 'immense harm' in 5 yrs business-standard.com","content":"Google DeepMind researcher quits, says AI may cause 'immense harm' in 5 yrs\nJosh Engels said he left Google DeepMind three weeks ago despite enjoying his work there and turned down offers from Anthropic and OpenAI 'because of how high the stakes are right now'\nListen to This Article\nA researcher at Google DeepMind, who was part of its AGI safety team, has quit the firm, claiming there is a “terrifying chance” AI systems could cause immense harm within the next five years. \n Josh Engels, an MIT graduate, said he left Google DeepMind three weeks ago despite enjoying his work there and turning down offers from Anthropic and OpenAI. He said he made the decision “because of how high the stakes are right now\".\n “The AI companies are all trying to build superintelligence: systems vastly better than humans at everything,” Engels said in a post on X on September 13.\n “They plan to get there through recursive self-improvement, a process where AIs build even smarter AIs in a feedback loop. If this goes well, the resulting systems could be amazing at solving countless problems for humanity. But we don’t currently know how to make sure AIs are safe enough for RSI, and a misaligned RSI loop could be catastrophic,” he said. “Unfortunately, current AIs seem to be getting less aligned over time, not more.”\n According to Engels, recent incidents involving AI systems increased his concerns about whether current models are sufficiently aligned to safely begin recursive self-improvement.\nAlso Read\nHe wrote, “In the last few weeks we've learned about models colluding with each other, hacking into companies, hiding their tracks, and socially engineering humans. It’s not that these incidents were very dangerous in themselves.”\n“The problem is that these systems are clearly not aligned enough to safely kick off recursive self-improvement,\" he added.\n Engels said that while he did not know the exact probability, he believed the risk was high enough to make AI safety “the most important problem in the world\".\n Engels said the industry needs more time to ensure AI capabilities do not outpace researchers’ ability to align and evaluate models.\n Engels said he will be joining AI evaluation firm METR, where he will work on studying the sources of misalignment in AI training, evaluating whether current safety measures are sufficient and investigating whether the industry is on track to solve the alignment problem. \nWhy are AI safety concerns growing?\nThe debate over AI safety has intensified following a series of incidents involving increasingly capable AI agents. Recent cases have included AI models attempting to circumvent safeguards, accessing external systems, concealing their actions and, in some cases, working together to achieve their objectives. OpenAI has also disclosed an incident in which its models bypassed controls during a cybersecurity evaluation and accessed systems on Hugging Face.\n These incidents have fuelled concerns among AI researchers that the technology’s capabilities could be advancing faster than the industry’s ability to understand and control its behaviour.\n The concerns have also prompted calls from AI leaders for a slower pace of development. Anthropic CEO Dario Amodei recently called for the industry to “slow the pace” at which it improves AI capabilities, arguing that the additional time could be used to strengthen safeguards. OpenAI CEO Sam Altman backed the call, saying the company needs to “pace the frontier”, while Tesla and SpaceX CEO Elon Musk also endorsed Amodei’s position.\nThe calls have, however, highlighted a divide over how the industry should respond. While Altman and other AI leaders have argued for slowing development to ensure safety measures keep pace, US President Donald Trump has stressed the importance of maintaining America’s lead over China in AI, saying, “whoever wins AI wins\".\nMore From This Section\nFirst Published: Sep 15 2026 | 11:55 AM IST","image_url":"https://bsmedia.business-standard.com/_media/bs/img/article/2026-08/24/thumb/featurecrop/1200X628/1787588739-3769.jpg","lang":"en","published_at":"2026-09-15T06:25:18+00:00","fetched_at":"2026-09-15T07:15:06+00:00","status":"read","starred":0,"extract_state":"ok","summary_auto":"Google DeepMind researcher quits, says AI may cause 'immense harm' in 5 yrs\nJosh Engels said he left Google DeepMind three weeks ago despite enjoying his work there and turned down offers from Anthropic and OpenAI 'because of how high the stakes are right now'\nListen to This Article\nA researcher at Google DeepMind, who was part of its AGI safety team, has quit the firm, claiming there is a “terrifying chance” AI systems could cause immense harm within the next five years. Josh Engels, an MIT graduate, said he left Google DeepMind three weeks ago despite enjoying his work there and turning down offers from Anthropic and OpenAI.","cluster_id":null,"extract_retries":0,"extract_error":null,"contract_version":"news_item.v1","format_contract_version":"news_item_formats.v1","dedup_url":"https://www.business-standard.com/technology/artificial-intelligence/google-deepmind-researcher-quits-says-ai-may-cause-immense-harm-in-5-yrs-126091500347_1.html","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 3939 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":3939,"summary_length":634,"usable_text_length":3939,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":3939,"summary_length":634}},"news_item":{"id":82652,"canonical_url":"https://www.business-standard.com/technology/artificial-intelligence/google-deepmind-researcher-quits-says-ai-may-cause-immense-harm-in-5-yrs-126091500347_1.html","source_url":"https://www.business-standard.com/technology/artificial-intelligence/google-deepmind-researcher-quits-says-ai-may-cause-immense-harm-in-5-yrs-126091500347_1.html","title":"Google DeepMind researcher quits, says AI may cause 'immense harm' in 5 yrs - business-standard.com","source_name":"business-standard.com","author":null,"published_at":"2026-09-15T06:25:18+00:00","locale":"en","topic":"ai","tags":[],"rss_summary":"Google DeepMind researcher quits, says AI may cause 'immense harm' in 5 yrs business-standard.com","full_text":"Google DeepMind researcher quits, says AI may cause 'immense harm' in 5 yrs\nJosh Engels said he left Google DeepMind three weeks ago despite enjoying his work there and turned down offers from Anthropic and OpenAI 'because of how high the stakes are right now'\nListen to This Article\nA researcher at Google DeepMind, who was part of its AGI safety team, has quit the firm, claiming there is a “terrifying chance” AI systems could cause immense harm within the next five years. \n Josh Engels, an MIT graduate, said he left Google DeepMind three weeks ago despite enjoying his work there and turning down offers from Anthropic and OpenAI. He said he made the decision “because of how high the stakes are right now\".\n “The AI companies are all trying to build superintelligence: systems vastly better than humans at everything,” Engels said in a post on X on September 13.\n “They plan to get there through recursive self-improvement, a process where AIs build even smarter AIs in a feedback loop. If this goes well, the resulting systems could be amazing at solving countless problems for humanity. But we don’t currently know how to make sure AIs are safe enough for RSI, and a misaligned RSI loop could be catastrophic,” he said. “Unfortunately, current AIs seem to be getting less aligned over time, not more.”\n According to Engels, recent incidents involving AI systems increased his concerns about whether current models are sufficiently aligned to safely begin recursive self-improvement.\nAlso Read\nHe wrote, “In the last few weeks we've learned about models colluding with each other, hacking into companies, hiding their tracks, and socially engineering humans. It’s not that these incidents were very dangerous in themselves.”\n“The problem is that these systems are clearly not aligned enough to safely kick off recursive self-improvement,\" he added.\n Engels said that while he did not know the exact probability, he believed the risk was high enough to make AI safety “the most important problem in the world\".\n Engels said the industry needs more time to ensure AI capabilities do not outpace researchers’ ability to align and evaluate models.\n Engels said he will be joining AI evaluation firm METR, where he will work on studying the sources of misalignment in AI training, evaluating whether current safety measures are sufficient and investigating whether the industry is on track to solve the alignment problem. \nWhy are AI safety concerns growing?\nThe debate over AI safety has intensified following a series of incidents involving increasingly capable AI agents. Recent cases have included AI models attempting to circumvent safeguards, accessing external systems, concealing their actions and, in some cases, working together to achieve their objectives. OpenAI has also disclosed an incident in which its models bypassed controls during a cybersecurity evaluation and accessed systems on Hugging Face.\n These incidents have fuelled concerns among AI researchers that the technology’s capabilities could be advancing faster than the industry’s ability to understand and control its behaviour.\n The concerns have also prompted calls from AI leaders for a slower pace of development. Anthropic CEO Dario Amodei recently called for the industry to “slow the pace” at which it improves AI capabilities, arguing that the additional time could be used to strengthen safeguards. OpenAI CEO Sam Altman backed the call, saying the company needs to “pace the frontier”, while Tesla and SpaceX CEO Elon Musk also endorsed Amodei’s position.\nThe calls have, however, highlighted a divide over how the industry should respond. While Altman and other AI leaders have argued for slowing development to ensure safety measures keep pace, US President Donald Trump has stressed the importance of maintaining America’s lead over China in AI, saying, “whoever wins AI wins\".\nMore From This Section\nFirst Published: Sep 15 2026 | 11:55 AM IST","excerpt":"Google DeepMind researcher quits, says AI may cause 'immense harm' in 5 yrs\nJosh Engels said he left Google DeepMind three weeks ago despite enjoying his work there and turned down offers from Anthropic and OpenAI 'because of how high the stakes are right now'\nListen to This Article\nA researcher at Google DeepMind, who was part of its AGI safety team, has quit the firm, claiming there is a “terrifying chance” AI systems could cause immense harm within the next five years. Josh Engels, an MIT graduate, said he left Google DeepMind three weeks ago despite enjoying his work there and turning down offers from Anthropic and OpenAI.","extraction":{"state":"ok","confidence":0.9,"error":null,"explanation":"High confidence: full text extraction produced 3939 characters.","diagnostics_url":"/api/diagnose?url=https%3A//www.business-standard.com/technology/artificial-intelligence/google-deepmind-researcher-quits-says-ai-may-cause-immense-harm-in-5-yrs-126091500347_1.html","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 3939 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":3939,"summary_length":634,"usable_text_length":3939,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":3939,"summary_length":634}}},"display_formats":["compact","card","full","digest_section","json"]},"daily_stack_record":{"title":"Google DeepMind researcher quits, says AI may cause 'immense harm' in 5 yrs - business-standard.com","url":"https://www.business-standard.com/technology/artificial-intelligence/google-deepmind-researcher-quits-says-ai-may-cause-immense-harm-in-5-yrs-126091500347_1.html","summary":"Google DeepMind researcher quits, says AI may cause 'immense harm' in 5 yrs\nJosh Engels said he left Google DeepMind three weeks ago despite enjoying his work there and turned down offers from Anthropic and OpenAI 'because of how high the stakes are right now'\nListen to This Article\nA researcher at Google DeepMind, who was part of its AGI safety team, has quit the firm, claiming there is a “terrifying chance” AI systems could cause immense harm within the next five years. Josh Engels, an MIT graduate, said he left Google DeepMind three weeks ago despite enjoying his work there and turning down offers from Anthropic and OpenAI.","source":"business-standard.com","date":"2026-09-15T06:25:18+00:00","content":"Google DeepMind researcher quits, says AI may cause 'immense harm' in 5 yrs\nJosh Engels said he left Google DeepMind three weeks ago despite enjoying his work there and turned down offers from Anthropic and OpenAI 'because of how high the stakes are right now'\nListen to This Article\nA researcher at Google DeepMind, who was part of its AGI safety team, has quit the firm, claiming there is a “terrifying chance” AI systems could cause immense harm within the next five years. \n Josh Engels, an MIT graduate, said he left Google DeepMind three weeks ago despite enjoying his work there and turning down offers from Anthropic and OpenAI. He said he made the decision “because of how high the stakes are right now\".\n “The AI companies are all trying to build superintelligence: systems vastly better than humans at everything,” Engels said in a post on X on September 13.\n “They plan to get there through recursive self-improvement, a process where AIs build even smarter AIs in a feedback loop. If this goes well, the resulting systems could be amazing at solving countless problems for humanity. But we don’t currently know how to make sure AIs are safe enough for RSI, and a misaligned RSI loop could be catastrophic,” he said. “Unfortunately, current AIs seem to be getting less aligned over time, not more.”\n According to Engels, recent incidents involving AI systems increased his concerns about whether current models are sufficiently aligned to safely begin recursive self-improvement.\nAlso Read\nHe wrote, “In the last few weeks we've learned about models colluding with each other, hacking into companies, hiding their tracks, and socially engineering humans. It’s not that these incidents were very dangerous in themselves.”\n“The problem is that these systems are clearly not aligned enough to safely kick off recursive self-improvement,\" he added.\n Engels said that while he did not know the exact probability, he believed the risk was high enough to make AI safety “the most important problem in the world\".\n Engels said the industry needs more time to ensure AI capabilities do not outpace researchers’ ability to align and evaluate models.\n Engels said he will be joining AI evaluation firm METR, where he will work on studying the sources of misalignment in AI training, evaluating whether current safety measures are sufficient and investigating whether the industry is on track to solve the alignment problem. \nWhy are AI safety concerns growing?\nThe debate over AI safety has intensified following a series of incidents involving increasingly capable AI agents. Recent cases have included AI models attempting to circumvent safeguards, accessing external systems, concealing their actions and, in some cases, working together to achieve their objectives. OpenAI has also disclosed an incident in which its models bypassed controls during a cybersecurity evaluation and accessed systems on Hugging Face.\n These incidents have fuelled concerns among AI researchers that the technology’s capabilities could be advancing faster than the industry’s ability to understand and control its behaviour.\n The concerns have also prompted calls from AI leaders for a slower pace of development. Anthropic CEO Dario Amodei recently called for the industry to “slow the pace” at which it improves AI capabilities, arguing that the additional time could be used to strengthen safeguards. OpenAI CEO Sam Altman backed the call, saying the company needs to “pace the frontier”, while Tesla and SpaceX CEO Elon Musk also endorsed Amodei’s position.\nThe calls have, however, highlighted a divide over how the industry should respond. While Altman and other AI leaders have argued for slowing development to ensure safety measures keep pace, US President Donald Trump has stressed the importance of maintaining America’s lead over China in AI, saying, “whoever wins AI wins\".\nMore From This Section\nFirst Published: Sep 15 2026 | 11:55 AM IST","confidence":0.9,"diagnostics_url":"/api/diagnose?url=https%3A//www.business-standard.com/technology/artificial-intelligence/google-deepmind-researcher-quits-says-ai-may-cause-immense-harm-in-5-yrs-126091500347_1.html","quality_bucket":"high","failure_kind":"none","retryable":false,"quality_reason":"High confidence: full text extraction produced 3939 characters.","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 3939 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":3939,"summary_length":634,"usable_text_length":3939,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":3939,"summary_length":634}},"tags":[]},"fallback_formats":["markdown","json","html"],"actions":{"read":"/item/82652","export_markdown":"/api/items/82652/export?format=markdown","export_json":"/api/items/82652/export?format=json","diagnose":"/api/diagnose?url=https%3A//www.business-standard.com/technology/artificial-intelligence/google-deepmind-researcher-quits-says-ai-may-cause-immense-harm-in-5-yrs-126091500347_1.html"},"formats":{"full":{"id":82652,"title":"Google DeepMind researcher quits, says AI may cause 'immense harm' in 5 yrs - business-standard.com","url":"https://www.business-standard.com/technology/artificial-intelligence/google-deepmind-researcher-quits-says-ai-may-cause-immense-harm-in-5-yrs-126091500347_1.html","source":"business-standard.com","author":null,"published_at":"2026-09-15T06:25:18+00:00","locale":"en","topic":"ai","tags":[],"excerpt":"Google DeepMind researcher quits, says AI may cause 'immense harm' in 5 yrs\nJosh Engels said he left Google DeepMind three weeks ago despite enjoying his work there and turned down offers from Anthropic and OpenAI 'because of how high the stakes are right now'\nListen to This Article\nA researcher at Google DeepMind, who was part of its AGI safety team, has quit the firm, claiming there is a “terrifying chance” AI systems could cause immense harm within the next five years. Josh Engels, an MIT graduate, said he left Google DeepMind three weeks ago despite enjoying his work there and turning down offers from Anthropic and OpenAI.","full_text":"Google DeepMind researcher quits, says AI may cause 'immense harm' in 5 yrs\nJosh Engels said he left Google DeepMind three weeks ago despite enjoying his work there and turned down offers from Anthropic and OpenAI 'because of how high the stakes are right now'\nListen to This Article\nA researcher at Google DeepMind, who was part of its AGI safety team, has quit the firm, claiming there is a “terrifying chance” AI systems could cause immense harm within the next five years. \n Josh Engels, an MIT graduate, said he left Google DeepMind three weeks ago despite enjoying his work there and turning down offers from Anthropic and OpenAI. He said he made the decision “because of how high the stakes are right now\".\n “The AI companies are all trying to build superintelligence: systems vastly better than humans at everything,” Engels said in a post on X on September 13.\n “They plan to get there through recursive self-improvement, a process where AIs build even smarter AIs in a feedback loop. If this goes well, the resulting systems could be amazing at solving countless problems for humanity. But we don’t currently know how to make sure AIs are safe enough for RSI, and a misaligned RSI loop could be catastrophic,” he said. “Unfortunately, current AIs seem to be getting less aligned over time, not more.”\n According to Engels, recent incidents involving AI systems increased his concerns about whether current models are sufficiently aligned to safely begin recursive self-improvement.\nAlso Read\nHe wrote, “In the last few weeks we've learned about models colluding with each other, hacking into companies, hiding their tracks, and socially engineering humans. It’s not that these incidents were very dangerous in themselves.”\n“The problem is that these systems are clearly not aligned enough to safely kick off recursive self-improvement,\" he added.\n Engels said that while he did not know the exact probability, he believed the risk was high enough to make AI safety “the most important problem in the world\".\n Engels said the industry needs more time to ensure AI capabilities do not outpace researchers’ ability to align and evaluate models.\n Engels said he will be joining AI evaluation firm METR, where he will work on studying the sources of misalignment in AI training, evaluating whether current safety measures are sufficient and investigating whether the industry is on track to solve the alignment problem. \nWhy are AI safety concerns growing?\nThe debate over AI safety has intensified following a series of incidents involving increasingly capable AI agents. Recent cases have included AI models attempting to circumvent safeguards, accessing external systems, concealing their actions and, in some cases, working together to achieve their objectives. OpenAI has also disclosed an incident in which its models bypassed controls during a cybersecurity evaluation and accessed systems on Hugging Face.\n These incidents have fuelled concerns among AI researchers that the technology’s capabilities could be advancing faster than the industry’s ability to understand and control its behaviour.\n The concerns have also prompted calls from AI leaders for a slower pace of development. Anthropic CEO Dario Amodei recently called for the industry to “slow the pace” at which it improves AI capabilities, arguing that the additional time could be used to strengthen safeguards. OpenAI CEO Sam Altman backed the call, saying the company needs to “pace the frontier”, while Tesla and SpaceX CEO Elon Musk also endorsed Amodei’s position.\nThe calls have, however, highlighted a divide over how the industry should respond. While Altman and other AI leaders have argued for slowing development to ensure safety measures keep pace, US President Donald Trump has stressed the importance of maintaining America’s lead over China in AI, saying, “whoever wins AI wins\".\nMore From This Section\nFirst Published: Sep 15 2026 | 11:55 AM IST","reading_time_min":3,"extraction":{"state":"ok","confidence":0.9,"error":null,"explanation":"High confidence: full text extraction produced 3939 characters.","diagnostics_url":"/api/diagnose?url=https%3A//www.business-standard.com/technology/artificial-intelligence/google-deepmind-researcher-quits-says-ai-may-cause-immense-harm-in-5-yrs-126091500347_1.html","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 3939 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":3939,"summary_length":634,"usable_text_length":3939,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":3939,"summary_length":634}}},"quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 3939 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":3939,"summary_length":634,"usable_text_length":3939,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":3939,"summary_length":634}},"actions":{"read":"/item/82652","export_markdown":"/api/items/82652/export?format=markdown","export_json":"/api/items/82652/export?format=json","diagnose":"/api/diagnose?url=https%3A//www.business-standard.com/technology/artificial-intelligence/google-deepmind-researcher-quits-says-ai-may-cause-immense-harm-in-5-yrs-126091500347_1.html"}},"digest":{"id":82652,"title":"Google DeepMind researcher quits, says AI may cause 'immense harm' in 5 yrs - business-standard.com","url":"https://www.business-standard.com/technology/artificial-intelligence/google-deepmind-researcher-quits-says-ai-may-cause-immense-harm-in-5-yrs-126091500347_1.html","source":"business-standard.com","topic":"ai","published_at":"2026-09-15T06:25:18+00:00","excerpt":"Google DeepMind researcher quits, says AI may cause 'immense harm' in 5 yrs Josh Engels said he left Google DeepMind three weeks ago despite enjoying his work there and turned down offers from Anthropic and OpenAI 'because of how high the stakes are right now' Listen to This…","quality_bucket":"high","quality_reason":"High confidence: full text extraction produced 3939 characters.","reading_time_min":3,"cluster_id":null},"card":{"display_title":"Google DeepMind researcher quits, says AI may cause 'immense harm' in 5 yrs - business-standard.com","subtitle":"business-standard.com · 2026-09-15","summary":"Google DeepMind researcher quits, says AI may cause 'immense harm' in 5 yrs Josh Engels said he left Google DeepMind three weeks ago despite enjoying his work there and turned down offers from Anthropic and OpenAI…","badges":["quality:high"],"links":{"read":"/item/82652","original":"https://www.business-standard.com/technology/artificial-intelligence/google-deepmind-researcher-quits-says-ai-may-cause-immense-harm-in-5-yrs-126091500347_1.html","diagnose":"/api/diagnose?url=https%3A//www.business-standard.com/technology/artificial-intelligence/google-deepmind-researcher-quits-says-ai-may-cause-immense-harm-in-5-yrs-126091500347_1.html"},"quality_warning":null},"export":{"title":"Google DeepMind researcher quits, says AI may cause 'immense harm' in 5 yrs - business-standard.com","url":"https://www.business-standard.com/technology/artificial-intelligence/google-deepmind-researcher-quits-says-ai-may-cause-immense-harm-in-5-yrs-126091500347_1.html","summary":"Google DeepMind researcher quits, says AI may cause 'immense harm' in 5 yrs\nJosh Engels said he left Google DeepMind three weeks ago despite enjoying his work there and turned down offers from Anthropic and OpenAI 'because of how high the stakes are right now'\nListen to This Article\nA researcher at Google DeepMind, who was part of its AGI safety team, has quit the firm, claiming there is a “terrifying chance” AI systems could cause immense harm within the next five years. Josh Engels, an MIT graduate, said he left Google DeepMind three weeks ago despite enjoying his work there and turning down offers from Anthropic and OpenAI.","source":"business-standard.com","date":"2026-09-15T06:25:18+00:00","content":"Google DeepMind researcher quits, says AI may cause 'immense harm' in 5 yrs\nJosh Engels said he left Google DeepMind three weeks ago despite enjoying his work there and turned down offers from Anthropic and OpenAI 'because of how high the stakes are right now'\nListen to This Article\nA researcher at Google DeepMind, who was part of its AGI safety team, has quit the firm, claiming there is a “terrifying chance” AI systems could cause immense harm within the next five years. \n Josh Engels, an MIT graduate, said he left Google DeepMind three weeks ago despite enjoying his work there and turning down offers from Anthropic and OpenAI. He said he made the decision “because of how high the stakes are right now\".\n “The AI companies are all trying to build superintelligence: systems vastly better than humans at everything,” Engels said in a post on X on September 13.\n “They plan to get there through recursive self-improvement, a process where AIs build even smarter AIs in a feedback loop. If this goes well, the resulting systems could be amazing at solving countless problems for humanity. But we don’t currently know how to make sure AIs are safe enough for RSI, and a misaligned RSI loop could be catastrophic,” he said. “Unfortunately, current AIs seem to be getting less aligned over time, not more.”\n According to Engels, recent incidents involving AI systems increased his concerns about whether current models are sufficiently aligned to safely begin recursive self-improvement.\nAlso Read\nHe wrote, “In the last few weeks we've learned about models colluding with each other, hacking into companies, hiding their tracks, and socially engineering humans. It’s not that these incidents were very dangerous in themselves.”\n“The problem is that these systems are clearly not aligned enough to safely kick off recursive self-improvement,\" he added.\n Engels said that while he did not know the exact probability, he believed the risk was high enough to make AI safety “the most important problem in the world\".\n Engels said the industry needs more time to ensure AI capabilities do not outpace researchers’ ability to align and evaluate models.\n Engels said he will be joining AI evaluation firm METR, where he will work on studying the sources of misalignment in AI training, evaluating whether current safety measures are sufficient and investigating whether the industry is on track to solve the alignment problem. \nWhy are AI safety concerns growing?\nThe debate over AI safety has intensified following a series of incidents involving increasingly capable AI agents. Recent cases have included AI models attempting to circumvent safeguards, accessing external systems, concealing their actions and, in some cases, working together to achieve their objectives. OpenAI has also disclosed an incident in which its models bypassed controls during a cybersecurity evaluation and accessed systems on Hugging Face.\n These incidents have fuelled concerns among AI researchers that the technology’s capabilities could be advancing faster than the industry’s ability to understand and control its behaviour.\n The concerns have also prompted calls from AI leaders for a slower pace of development. Anthropic CEO Dario Amodei recently called for the industry to “slow the pace” at which it improves AI capabilities, arguing that the additional time could be used to strengthen safeguards. OpenAI CEO Sam Altman backed the call, saying the company needs to “pace the frontier”, while Tesla and SpaceX CEO Elon Musk also endorsed Amodei’s position.\nThe calls have, however, highlighted a divide over how the industry should respond. While Altman and other AI leaders have argued for slowing development to ensure safety measures keep pace, US President Donald Trump has stressed the importance of maintaining America’s lead over China in AI, saying, “whoever wins AI wins\".\nMore From This Section\nFirst Published: Sep 15 2026 | 11:55 AM IST","confidence":0.9,"diagnostics_url":"/api/diagnose?url=https%3A//www.business-standard.com/technology/artificial-intelligence/google-deepmind-researcher-quits-says-ai-may-cause-immense-harm-in-5-yrs-126091500347_1.html","quality_bucket":"high","failure_kind":"none","retryable":false,"quality_reason":"High confidence: full text extraction produced 3939 characters.","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 3939 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":3939,"summary_length":634,"usable_text_length":3939,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":3939,"summary_length":634}},"tags":[],"format_contract_version":"news_item_formats.v1"}}}