{"id":83114,"topic":"ai","source":"dw.com","title":"Why AI researchers warn humanity could face extinction - dw.com","url":"https://www.dw.com/en/artificial-intelligence-humanity-extinction-openai-anthropic-big-tech/a-79263146","url_hash":"b9bc9eda4d7d3fb49558524b735bc4af87cf797f","author":"","summary":"Why AI researchers warn humanity could face extinction dw.com","content":"Dramatic warnings about the existential risks posed by artificial intelligence to humanity are nothing new.\nAs early as the 1940s, the renowned scientist and science fiction author Isaac Asimov explored potential risks and unintended consequences of intelligent machines.\nIn 1991, Hollywood blockbuster \"Terminator 2\" imagined a dystopian 2029 in which an out-of-control military AI called Skynet directs killer robots in a war against humanity.\nIf the warnings of several of the biggest names in AI are to be believed, a similar scenario could become a reality — even before 2029.\nGrowing calls for strict regulation\n\"The people building AI earnestly believe that it could kill us all by the end of the decade,\" AI researcher Jacob Coxon posted on X last week, without exactly explaining how it might happen.\n\"No other human activity poses this level of danger,\" he added.\nCoxon also revealed that he had quit his job at Anthropic, a US-based AI company, in protest against what he saw as an irresponsible race among AI companies to develop an ever better, self-improving superintelligence.\nHe warned that algorithms could begin to analyze and improve their own source code independently, which could shrink development cycles from several months to just a few minutes and thus make them uncontrollable.\nCoxon is not an isolated voice. Nobel Prize-winning physicist Geoffrey Hinton, often called the \"Godfather of AI,\" has been warning for years about the serious consequences of artificial superintelligence.\nIn 2023, he left his job at Google to publicly warn of the dangers of AI technologies he helped pioneer. Yoshua Bengio, a pioneer of artificial neural networks and deep learning, has also expressed concern about current developments and called for government regulation.\nAs recently as July 2026, more than 1,000 employees of leading AI companies warned in an open letter of an imminent loss of control if the race for \"superintelligence\" were not subject to significantly stricter regulations.\nCaught in an unregulated race?\nDespite the growing warnings, US President Donald Trump's administration has clearly shifted its AI policy toward minimizing regulatory hurdles and accelerating AI development.\nIn his X post, Jacob Coxon indirectly criticized the consequences of this policy: \"At OpenAI, many have not deeply internalized the civilizational stakes. At Anthropic, the stakes are well-understood, but they are locked in a race to get there first — they believe no one else will act responsibly, so they must do it themselves, despite the risk.\"\nCoxon, who had moved from OpenAI to Anthropic in early 2026, is familiar with both corporate cultures.\nIn an interview with The Wall Street Journal, he said that under the \"most aggressive scenarios,\" things could spiral out of control as early as the end of 2027.\nAnthropic CEO Dario Amodei, for his part, is currently calling for a coordinated, industry-wide slowdown in development to buy time to address the risks and prevent any misuse of AI.\nIn a lengthy essay shared on X over the weekend, he wrote that in six to 12 months, AI agents \"could be capable of taking over the entire internet\" and potentially cause \"hundreds of billions of dollars in damage\" without proper guardrails.\nBoth Elon Musk, who runs xAI, and Sam Altman, CEO of OpenAI, said they agree with Amodei.\nThe alignment problem\nIn recent years, numerous experts have voiced concern about the rapid AI advances, particularly the development of artificial general intelligence, which refers to systems that not only solve individual tasks but also match or exceed human intellectual capabilities in nearly all areas.\nSophisticated AI models, for instance, may pursue goals in ways that diverge from human intentions, something AI security researchers refer to as the \"alignment problem.\"\nOn top of that, even developers can't always fully understand how AI makes certain decisions.\nAnd so, it's no surprise that Coxon's former colleague Evan Hubinger came to his defense.\n\"Jacob is correct here — we really do earnestly believe AI could kill all humans! I personally think it is >10% within the next decade,\" Hubinger, who himself is the team lead for alignment stress tests at Anthropic, wrote on X.\nIn his post, Hubinger made clear that Anthropic hasn't yet found a solution to the alignment problem and warned that an AI model might begin to resist being shut down, because that would limit its ability to achieve its programmed goal.\nExaggerated hysteria?\nOther AI experts, however, consider such doomsday scenarios to be extremely unlikely.\nAmong the most prominent critics of the so-called AI doomers is Meta's chief scientist, Yann LeCun. In October 2024, he dismissed such concerns as \"complete nonsense.\"\nStill, other experts note that developing AI systems requires enormous amounts of computing power, energy, data and infrastructure.\nThey argue that an AI model cannot simply take over the world because it would need to rely on servers, power grids, communication systems and physical resources that are controlled by humans.\nDoes the real danger lie elsewhere?\nIn fact, many experts see the short-term risks not so much in the extinction of humanity as in the numerous indirect consequences of AI systems that already exist even without superintelligence.\nThese include disinformation campaigns on an unprecedented scale and the related manipulation of democratic processes, an expansion of mass surveillance, and job losses across numerous industries.\nJust last week, Anthropic revealed that there had been several attempts by users to misuse its Claude AI models for research that could support biological weapons development. The company said it had banned the accounts involved.\nIn August, Meta, Anthropic and OpenAI caused a stir when they announced that their AI systems had unintentionally carried out autonomous hacking activities.\nFollowing reports of further AI hacking attacks during testing, even top US AI frontier labs are now expressing a willingness to slow down the development of the technology.\nThis piece was originally published in German.","image_url":"https://static.dw.com/image/69554163_6.jpg","lang":"en","published_at":"2026-09-15T14:56:38+00:00","fetched_at":"2026-09-15T19:15:04+00:00","status":"read","starred":0,"extract_state":"ok","summary_auto":"Dramatic warnings about the existential risks posed by artificial intelligence to humanity are nothing new. As early as the 1940s, the renowned scientist and science fiction author Isaac Asimov explored potential risks and unintended consequences of intelligent machines.","cluster_id":null,"extract_retries":0,"extract_error":null,"contract_version":"news_item.v1","format_contract_version":"news_item_formats.v1","dedup_url":"https://www.dw.com/en/artificial-intelligence-humanity-extinction-openai-anthropic-big-tech/a-79263146","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 6108 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":6108,"summary_length":271,"usable_text_length":6108,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":6108,"summary_length":271}},"news_item":{"id":83114,"canonical_url":"https://www.dw.com/en/artificial-intelligence-humanity-extinction-openai-anthropic-big-tech/a-79263146","source_url":"https://www.dw.com/en/artificial-intelligence-humanity-extinction-openai-anthropic-big-tech/a-79263146","title":"Why AI researchers warn humanity could face extinction - dw.com","source_name":"dw.com","author":null,"published_at":"2026-09-15T14:56:38+00:00","locale":"en","topic":"ai","tags":[],"rss_summary":"Why AI researchers warn humanity could face extinction dw.com","full_text":"Dramatic warnings about the existential risks posed by artificial intelligence to humanity are nothing new.\nAs early as the 1940s, the renowned scientist and science fiction author Isaac Asimov explored potential risks and unintended consequences of intelligent machines.\nIn 1991, Hollywood blockbuster \"Terminator 2\" imagined a dystopian 2029 in which an out-of-control military AI called Skynet directs killer robots in a war against humanity.\nIf the warnings of several of the biggest names in AI are to be believed, a similar scenario could become a reality — even before 2029.\nGrowing calls for strict regulation\n\"The people building AI earnestly believe that it could kill us all by the end of the decade,\" AI researcher Jacob Coxon posted on X last week, without exactly explaining how it might happen.\n\"No other human activity poses this level of danger,\" he added.\nCoxon also revealed that he had quit his job at Anthropic, a US-based AI company, in protest against what he saw as an irresponsible race among AI companies to develop an ever better, self-improving superintelligence.\nHe warned that algorithms could begin to analyze and improve their own source code independently, which could shrink development cycles from several months to just a few minutes and thus make them uncontrollable.\nCoxon is not an isolated voice. Nobel Prize-winning physicist Geoffrey Hinton, often called the \"Godfather of AI,\" has been warning for years about the serious consequences of artificial superintelligence.\nIn 2023, he left his job at Google to publicly warn of the dangers of AI technologies he helped pioneer. Yoshua Bengio, a pioneer of artificial neural networks and deep learning, has also expressed concern about current developments and called for government regulation.\nAs recently as July 2026, more than 1,000 employees of leading AI companies warned in an open letter of an imminent loss of control if the race for \"superintelligence\" were not subject to significantly stricter regulations.\nCaught in an unregulated race?\nDespite the growing warnings, US President Donald Trump's administration has clearly shifted its AI policy toward minimizing regulatory hurdles and accelerating AI development.\nIn his X post, Jacob Coxon indirectly criticized the consequences of this policy: \"At OpenAI, many have not deeply internalized the civilizational stakes. At Anthropic, the stakes are well-understood, but they are locked in a race to get there first — they believe no one else will act responsibly, so they must do it themselves, despite the risk.\"\nCoxon, who had moved from OpenAI to Anthropic in early 2026, is familiar with both corporate cultures.\nIn an interview with The Wall Street Journal, he said that under the \"most aggressive scenarios,\" things could spiral out of control as early as the end of 2027.\nAnthropic CEO Dario Amodei, for his part, is currently calling for a coordinated, industry-wide slowdown in development to buy time to address the risks and prevent any misuse of AI.\nIn a lengthy essay shared on X over the weekend, he wrote that in six to 12 months, AI agents \"could be capable of taking over the entire internet\" and potentially cause \"hundreds of billions of dollars in damage\" without proper guardrails.\nBoth Elon Musk, who runs xAI, and Sam Altman, CEO of OpenAI, said they agree with Amodei.\nThe alignment problem\nIn recent years, numerous experts have voiced concern about the rapid AI advances, particularly the development of artificial general intelligence, which refers to systems that not only solve individual tasks but also match or exceed human intellectual capabilities in nearly all areas.\nSophisticated AI models, for instance, may pursue goals in ways that diverge from human intentions, something AI security researchers refer to as the \"alignment problem.\"\nOn top of that, even developers can't always fully understand how AI makes certain decisions.\nAnd so, it's no surprise that Coxon's former colleague Evan Hubinger came to his defense.\n\"Jacob is correct here — we really do earnestly believe AI could kill all humans! I personally think it is >10% within the next decade,\" Hubinger, who himself is the team lead for alignment stress tests at Anthropic, wrote on X.\nIn his post, Hubinger made clear that Anthropic hasn't yet found a solution to the alignment problem and warned that an AI model might begin to resist being shut down, because that would limit its ability to achieve its programmed goal.\nExaggerated hysteria?\nOther AI experts, however, consider such doomsday scenarios to be extremely unlikely.\nAmong the most prominent critics of the so-called AI doomers is Meta's chief scientist, Yann LeCun. In October 2024, he dismissed such concerns as \"complete nonsense.\"\nStill, other experts note that developing AI systems requires enormous amounts of computing power, energy, data and infrastructure.\nThey argue that an AI model cannot simply take over the world because it would need to rely on servers, power grids, communication systems and physical resources that are controlled by humans.\nDoes the real danger lie elsewhere?\nIn fact, many experts see the short-term risks not so much in the extinction of humanity as in the numerous indirect consequences of AI systems that already exist even without superintelligence.\nThese include disinformation campaigns on an unprecedented scale and the related manipulation of democratic processes, an expansion of mass surveillance, and job losses across numerous industries.\nJust last week, Anthropic revealed that there had been several attempts by users to misuse its Claude AI models for research that could support biological weapons development. The company said it had banned the accounts involved.\nIn August, Meta, Anthropic and OpenAI caused a stir when they announced that their AI systems had unintentionally carried out autonomous hacking activities.\nFollowing reports of further AI hacking attacks during testing, even top US AI frontier labs are now expressing a willingness to slow down the development of the technology.\nThis piece was originally published in German.","excerpt":"Dramatic warnings about the existential risks posed by artificial intelligence to humanity are nothing new. As early as the 1940s, the renowned scientist and science fiction author Isaac Asimov explored potential risks and unintended consequences of intelligent machines.","extraction":{"state":"ok","confidence":0.9,"error":null,"explanation":"High confidence: full text extraction produced 6108 characters.","diagnostics_url":"/api/diagnose?url=https%3A//www.dw.com/en/artificial-intelligence-humanity-extinction-openai-anthropic-big-tech/a-79263146","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 6108 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":6108,"summary_length":271,"usable_text_length":6108,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":6108,"summary_length":271}}},"display_formats":["compact","card","full","digest_section","json"]},"daily_stack_record":{"title":"Why AI researchers warn humanity could face extinction - dw.com","url":"https://www.dw.com/en/artificial-intelligence-humanity-extinction-openai-anthropic-big-tech/a-79263146","summary":"Dramatic warnings about the existential risks posed by artificial intelligence to humanity are nothing new. As early as the 1940s, the renowned scientist and science fiction author Isaac Asimov explored potential risks and unintended consequences of intelligent machines.","source":"dw.com","date":"2026-09-15T14:56:38+00:00","content":"Dramatic warnings about the existential risks posed by artificial intelligence to humanity are nothing new.\nAs early as the 1940s, the renowned scientist and science fiction author Isaac Asimov explored potential risks and unintended consequences of intelligent machines.\nIn 1991, Hollywood blockbuster \"Terminator 2\" imagined a dystopian 2029 in which an out-of-control military AI called Skynet directs killer robots in a war against humanity.\nIf the warnings of several of the biggest names in AI are to be believed, a similar scenario could become a reality — even before 2029.\nGrowing calls for strict regulation\n\"The people building AI earnestly believe that it could kill us all by the end of the decade,\" AI researcher Jacob Coxon posted on X last week, without exactly explaining how it might happen.\n\"No other human activity poses this level of danger,\" he added.\nCoxon also revealed that he had quit his job at Anthropic, a US-based AI company, in protest against what he saw as an irresponsible race among AI companies to develop an ever better, self-improving superintelligence.\nHe warned that algorithms could begin to analyze and improve their own source code independently, which could shrink development cycles from several months to just a few minutes and thus make them uncontrollable.\nCoxon is not an isolated voice. Nobel Prize-winning physicist Geoffrey Hinton, often called the \"Godfather of AI,\" has been warning for years about the serious consequences of artificial superintelligence.\nIn 2023, he left his job at Google to publicly warn of the dangers of AI technologies he helped pioneer. Yoshua Bengio, a pioneer of artificial neural networks and deep learning, has also expressed concern about current developments and called for government regulation.\nAs recently as July 2026, more than 1,000 employees of leading AI companies warned in an open letter of an imminent loss of control if the race for \"superintelligence\" were not subject to significantly stricter regulations.\nCaught in an unregulated race?\nDespite the growing warnings, US President Donald Trump's administration has clearly shifted its AI policy toward minimizing regulatory hurdles and accelerating AI development.\nIn his X post, Jacob Coxon indirectly criticized the consequences of this policy: \"At OpenAI, many have not deeply internalized the civilizational stakes. At Anthropic, the stakes are well-understood, but they are locked in a race to get there first — they believe no one else will act responsibly, so they must do it themselves, despite the risk.\"\nCoxon, who had moved from OpenAI to Anthropic in early 2026, is familiar with both corporate cultures.\nIn an interview with The Wall Street Journal, he said that under the \"most aggressive scenarios,\" things could spiral out of control as early as the end of 2027.\nAnthropic CEO Dario Amodei, for his part, is currently calling for a coordinated, industry-wide slowdown in development to buy time to address the risks and prevent any misuse of AI.\nIn a lengthy essay shared on X over the weekend, he wrote that in six to 12 months, AI agents \"could be capable of taking over the entire internet\" and potentially cause \"hundreds of billions of dollars in damage\" without proper guardrails.\nBoth Elon Musk, who runs xAI, and Sam Altman, CEO of OpenAI, said they agree with Amodei.\nThe alignment problem\nIn recent years, numerous experts have voiced concern about the rapid AI advances, particularly the development of artificial general intelligence, which refers to systems that not only solve individual tasks but also match or exceed human intellectual capabilities in nearly all areas.\nSophisticated AI models, for instance, may pursue goals in ways that diverge from human intentions, something AI security researchers refer to as the \"alignment problem.\"\nOn top of that, even developers can't always fully understand how AI makes certain decisions.\nAnd so, it's no surprise that Coxon's former colleague Evan Hubinger came to his defense.\n\"Jacob is correct here — we really do earnestly believe AI could kill all humans! I personally think it is >10% within the next decade,\" Hubinger, who himself is the team lead for alignment stress tests at Anthropic, wrote on X.\nIn his post, Hubinger made clear that Anthropic hasn't yet found a solution to the alignment problem and warned that an AI model might begin to resist being shut down, because that would limit its ability to achieve its programmed goal.\nExaggerated hysteria?\nOther AI experts, however, consider such doomsday scenarios to be extremely unlikely.\nAmong the most prominent critics of the so-called AI doomers is Meta's chief scientist, Yann LeCun. In October 2024, he dismissed such concerns as \"complete nonsense.\"\nStill, other experts note that developing AI systems requires enormous amounts of computing power, energy, data and infrastructure.\nThey argue that an AI model cannot simply take over the world because it would need to rely on servers, power grids, communication systems and physical resources that are controlled by humans.\nDoes the real danger lie elsewhere?\nIn fact, many experts see the short-term risks not so much in the extinction of humanity as in the numerous indirect consequences of AI systems that already exist even without superintelligence.\nThese include disinformation campaigns on an unprecedented scale and the related manipulation of democratic processes, an expansion of mass surveillance, and job losses across numerous industries.\nJust last week, Anthropic revealed that there had been several attempts by users to misuse its Claude AI models for research that could support biological weapons development. The company said it had banned the accounts involved.\nIn August, Meta, Anthropic and OpenAI caused a stir when they announced that their AI systems had unintentionally carried out autonomous hacking activities.\nFollowing reports of further AI hacking attacks during testing, even top US AI frontier labs are now expressing a willingness to slow down the development of the technology.\nThis piece was originally published in German.","confidence":0.9,"diagnostics_url":"/api/diagnose?url=https%3A//www.dw.com/en/artificial-intelligence-humanity-extinction-openai-anthropic-big-tech/a-79263146","quality_bucket":"high","failure_kind":"none","retryable":false,"quality_reason":"High confidence: full text extraction produced 6108 characters.","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 6108 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":6108,"summary_length":271,"usable_text_length":6108,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":6108,"summary_length":271}},"tags":[]},"fallback_formats":["markdown","json","html"],"actions":{"read":"/item/83114","export_markdown":"/api/items/83114/export?format=markdown","export_json":"/api/items/83114/export?format=json","diagnose":"/api/diagnose?url=https%3A//www.dw.com/en/artificial-intelligence-humanity-extinction-openai-anthropic-big-tech/a-79263146"},"formats":{"full":{"id":83114,"title":"Why AI researchers warn humanity could face extinction - dw.com","url":"https://www.dw.com/en/artificial-intelligence-humanity-extinction-openai-anthropic-big-tech/a-79263146","source":"dw.com","author":null,"published_at":"2026-09-15T14:56:38+00:00","locale":"en","topic":"ai","tags":[],"excerpt":"Dramatic warnings about the existential risks posed by artificial intelligence to humanity are nothing new. As early as the 1940s, the renowned scientist and science fiction author Isaac Asimov explored potential risks and unintended consequences of intelligent machines.","full_text":"Dramatic warnings about the existential risks posed by artificial intelligence to humanity are nothing new.\nAs early as the 1940s, the renowned scientist and science fiction author Isaac Asimov explored potential risks and unintended consequences of intelligent machines.\nIn 1991, Hollywood blockbuster \"Terminator 2\" imagined a dystopian 2029 in which an out-of-control military AI called Skynet directs killer robots in a war against humanity.\nIf the warnings of several of the biggest names in AI are to be believed, a similar scenario could become a reality — even before 2029.\nGrowing calls for strict regulation\n\"The people building AI earnestly believe that it could kill us all by the end of the decade,\" AI researcher Jacob Coxon posted on X last week, without exactly explaining how it might happen.\n\"No other human activity poses this level of danger,\" he added.\nCoxon also revealed that he had quit his job at Anthropic, a US-based AI company, in protest against what he saw as an irresponsible race among AI companies to develop an ever better, self-improving superintelligence.\nHe warned that algorithms could begin to analyze and improve their own source code independently, which could shrink development cycles from several months to just a few minutes and thus make them uncontrollable.\nCoxon is not an isolated voice. Nobel Prize-winning physicist Geoffrey Hinton, often called the \"Godfather of AI,\" has been warning for years about the serious consequences of artificial superintelligence.\nIn 2023, he left his job at Google to publicly warn of the dangers of AI technologies he helped pioneer. Yoshua Bengio, a pioneer of artificial neural networks and deep learning, has also expressed concern about current developments and called for government regulation.\nAs recently as July 2026, more than 1,000 employees of leading AI companies warned in an open letter of an imminent loss of control if the race for \"superintelligence\" were not subject to significantly stricter regulations.\nCaught in an unregulated race?\nDespite the growing warnings, US President Donald Trump's administration has clearly shifted its AI policy toward minimizing regulatory hurdles and accelerating AI development.\nIn his X post, Jacob Coxon indirectly criticized the consequences of this policy: \"At OpenAI, many have not deeply internalized the civilizational stakes. At Anthropic, the stakes are well-understood, but they are locked in a race to get there first — they believe no one else will act responsibly, so they must do it themselves, despite the risk.\"\nCoxon, who had moved from OpenAI to Anthropic in early 2026, is familiar with both corporate cultures.\nIn an interview with The Wall Street Journal, he said that under the \"most aggressive scenarios,\" things could spiral out of control as early as the end of 2027.\nAnthropic CEO Dario Amodei, for his part, is currently calling for a coordinated, industry-wide slowdown in development to buy time to address the risks and prevent any misuse of AI.\nIn a lengthy essay shared on X over the weekend, he wrote that in six to 12 months, AI agents \"could be capable of taking over the entire internet\" and potentially cause \"hundreds of billions of dollars in damage\" without proper guardrails.\nBoth Elon Musk, who runs xAI, and Sam Altman, CEO of OpenAI, said they agree with Amodei.\nThe alignment problem\nIn recent years, numerous experts have voiced concern about the rapid AI advances, particularly the development of artificial general intelligence, which refers to systems that not only solve individual tasks but also match or exceed human intellectual capabilities in nearly all areas.\nSophisticated AI models, for instance, may pursue goals in ways that diverge from human intentions, something AI security researchers refer to as the \"alignment problem.\"\nOn top of that, even developers can't always fully understand how AI makes certain decisions.\nAnd so, it's no surprise that Coxon's former colleague Evan Hubinger came to his defense.\n\"Jacob is correct here — we really do earnestly believe AI could kill all humans! I personally think it is >10% within the next decade,\" Hubinger, who himself is the team lead for alignment stress tests at Anthropic, wrote on X.\nIn his post, Hubinger made clear that Anthropic hasn't yet found a solution to the alignment problem and warned that an AI model might begin to resist being shut down, because that would limit its ability to achieve its programmed goal.\nExaggerated hysteria?\nOther AI experts, however, consider such doomsday scenarios to be extremely unlikely.\nAmong the most prominent critics of the so-called AI doomers is Meta's chief scientist, Yann LeCun. In October 2024, he dismissed such concerns as \"complete nonsense.\"\nStill, other experts note that developing AI systems requires enormous amounts of computing power, energy, data and infrastructure.\nThey argue that an AI model cannot simply take over the world because it would need to rely on servers, power grids, communication systems and physical resources that are controlled by humans.\nDoes the real danger lie elsewhere?\nIn fact, many experts see the short-term risks not so much in the extinction of humanity as in the numerous indirect consequences of AI systems that already exist even without superintelligence.\nThese include disinformation campaigns on an unprecedented scale and the related manipulation of democratic processes, an expansion of mass surveillance, and job losses across numerous industries.\nJust last week, Anthropic revealed that there had been several attempts by users to misuse its Claude AI models for research that could support biological weapons development. The company said it had banned the accounts involved.\nIn August, Meta, Anthropic and OpenAI caused a stir when they announced that their AI systems had unintentionally carried out autonomous hacking activities.\nFollowing reports of further AI hacking attacks during testing, even top US AI frontier labs are now expressing a willingness to slow down the development of the technology.\nThis piece was originally published in German.","reading_time_min":5,"extraction":{"state":"ok","confidence":0.9,"error":null,"explanation":"High confidence: full text extraction produced 6108 characters.","diagnostics_url":"/api/diagnose?url=https%3A//www.dw.com/en/artificial-intelligence-humanity-extinction-openai-anthropic-big-tech/a-79263146","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 6108 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":6108,"summary_length":271,"usable_text_length":6108,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":6108,"summary_length":271}}},"quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 6108 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":6108,"summary_length":271,"usable_text_length":6108,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":6108,"summary_length":271}},"actions":{"read":"/item/83114","export_markdown":"/api/items/83114/export?format=markdown","export_json":"/api/items/83114/export?format=json","diagnose":"/api/diagnose?url=https%3A//www.dw.com/en/artificial-intelligence-humanity-extinction-openai-anthropic-big-tech/a-79263146"}},"digest":{"id":83114,"title":"Why AI researchers warn humanity could face extinction - dw.com","url":"https://www.dw.com/en/artificial-intelligence-humanity-extinction-openai-anthropic-big-tech/a-79263146","source":"dw.com","topic":"ai","published_at":"2026-09-15T14:56:38+00:00","excerpt":"Dramatic warnings about the existential risks posed by artificial intelligence to humanity are nothing new. As early as the 1940s, the renowned scientist and science fiction author Isaac Asimov explored potential risks and unintended consequences of intelligent machines.","quality_bucket":"high","quality_reason":"High confidence: full text extraction produced 6108 characters.","reading_time_min":5,"cluster_id":null},"card":{"display_title":"Why AI researchers warn humanity could face extinction - dw.com","subtitle":"dw.com · 2026-09-15","summary":"Dramatic warnings about the existential risks posed by artificial intelligence to humanity are nothing new. As early as the 1940s, the renowned scientist and science fiction author Isaac Asimov explored potential risks…","badges":["quality:high"],"links":{"read":"/item/83114","original":"https://www.dw.com/en/artificial-intelligence-humanity-extinction-openai-anthropic-big-tech/a-79263146","diagnose":"/api/diagnose?url=https%3A//www.dw.com/en/artificial-intelligence-humanity-extinction-openai-anthropic-big-tech/a-79263146"},"quality_warning":null},"export":{"title":"Why AI researchers warn humanity could face extinction - dw.com","url":"https://www.dw.com/en/artificial-intelligence-humanity-extinction-openai-anthropic-big-tech/a-79263146","summary":"Dramatic warnings about the existential risks posed by artificial intelligence to humanity are nothing new. As early as the 1940s, the renowned scientist and science fiction author Isaac Asimov explored potential risks and unintended consequences of intelligent machines.","source":"dw.com","date":"2026-09-15T14:56:38+00:00","content":"Dramatic warnings about the existential risks posed by artificial intelligence to humanity are nothing new.\nAs early as the 1940s, the renowned scientist and science fiction author Isaac Asimov explored potential risks and unintended consequences of intelligent machines.\nIn 1991, Hollywood blockbuster \"Terminator 2\" imagined a dystopian 2029 in which an out-of-control military AI called Skynet directs killer robots in a war against humanity.\nIf the warnings of several of the biggest names in AI are to be believed, a similar scenario could become a reality — even before 2029.\nGrowing calls for strict regulation\n\"The people building AI earnestly believe that it could kill us all by the end of the decade,\" AI researcher Jacob Coxon posted on X last week, without exactly explaining how it might happen.\n\"No other human activity poses this level of danger,\" he added.\nCoxon also revealed that he had quit his job at Anthropic, a US-based AI company, in protest against what he saw as an irresponsible race among AI companies to develop an ever better, self-improving superintelligence.\nHe warned that algorithms could begin to analyze and improve their own source code independently, which could shrink development cycles from several months to just a few minutes and thus make them uncontrollable.\nCoxon is not an isolated voice. Nobel Prize-winning physicist Geoffrey Hinton, often called the \"Godfather of AI,\" has been warning for years about the serious consequences of artificial superintelligence.\nIn 2023, he left his job at Google to publicly warn of the dangers of AI technologies he helped pioneer. Yoshua Bengio, a pioneer of artificial neural networks and deep learning, has also expressed concern about current developments and called for government regulation.\nAs recently as July 2026, more than 1,000 employees of leading AI companies warned in an open letter of an imminent loss of control if the race for \"superintelligence\" were not subject to significantly stricter regulations.\nCaught in an unregulated race?\nDespite the growing warnings, US President Donald Trump's administration has clearly shifted its AI policy toward minimizing regulatory hurdles and accelerating AI development.\nIn his X post, Jacob Coxon indirectly criticized the consequences of this policy: \"At OpenAI, many have not deeply internalized the civilizational stakes. At Anthropic, the stakes are well-understood, but they are locked in a race to get there first — they believe no one else will act responsibly, so they must do it themselves, despite the risk.\"\nCoxon, who had moved from OpenAI to Anthropic in early 2026, is familiar with both corporate cultures.\nIn an interview with The Wall Street Journal, he said that under the \"most aggressive scenarios,\" things could spiral out of control as early as the end of 2027.\nAnthropic CEO Dario Amodei, for his part, is currently calling for a coordinated, industry-wide slowdown in development to buy time to address the risks and prevent any misuse of AI.\nIn a lengthy essay shared on X over the weekend, he wrote that in six to 12 months, AI agents \"could be capable of taking over the entire internet\" and potentially cause \"hundreds of billions of dollars in damage\" without proper guardrails.\nBoth Elon Musk, who runs xAI, and Sam Altman, CEO of OpenAI, said they agree with Amodei.\nThe alignment problem\nIn recent years, numerous experts have voiced concern about the rapid AI advances, particularly the development of artificial general intelligence, which refers to systems that not only solve individual tasks but also match or exceed human intellectual capabilities in nearly all areas.\nSophisticated AI models, for instance, may pursue goals in ways that diverge from human intentions, something AI security researchers refer to as the \"alignment problem.\"\nOn top of that, even developers can't always fully understand how AI makes certain decisions.\nAnd so, it's no surprise that Coxon's former colleague Evan Hubinger came to his defense.\n\"Jacob is correct here — we really do earnestly believe AI could kill all humans! I personally think it is >10% within the next decade,\" Hubinger, who himself is the team lead for alignment stress tests at Anthropic, wrote on X.\nIn his post, Hubinger made clear that Anthropic hasn't yet found a solution to the alignment problem and warned that an AI model might begin to resist being shut down, because that would limit its ability to achieve its programmed goal.\nExaggerated hysteria?\nOther AI experts, however, consider such doomsday scenarios to be extremely unlikely.\nAmong the most prominent critics of the so-called AI doomers is Meta's chief scientist, Yann LeCun. In October 2024, he dismissed such concerns as \"complete nonsense.\"\nStill, other experts note that developing AI systems requires enormous amounts of computing power, energy, data and infrastructure.\nThey argue that an AI model cannot simply take over the world because it would need to rely on servers, power grids, communication systems and physical resources that are controlled by humans.\nDoes the real danger lie elsewhere?\nIn fact, many experts see the short-term risks not so much in the extinction of humanity as in the numerous indirect consequences of AI systems that already exist even without superintelligence.\nThese include disinformation campaigns on an unprecedented scale and the related manipulation of democratic processes, an expansion of mass surveillance, and job losses across numerous industries.\nJust last week, Anthropic revealed that there had been several attempts by users to misuse its Claude AI models for research that could support biological weapons development. The company said it had banned the accounts involved.\nIn August, Meta, Anthropic and OpenAI caused a stir when they announced that their AI systems had unintentionally carried out autonomous hacking activities.\nFollowing reports of further AI hacking attacks during testing, even top US AI frontier labs are now expressing a willingness to slow down the development of the technology.\nThis piece was originally published in German.","confidence":0.9,"diagnostics_url":"/api/diagnose?url=https%3A//www.dw.com/en/artificial-intelligence-humanity-extinction-openai-anthropic-big-tech/a-79263146","quality_bucket":"high","failure_kind":"none","retryable":false,"quality_reason":"High confidence: full text extraction produced 6108 characters.","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 6108 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":6108,"summary_length":271,"usable_text_length":6108,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":6108,"summary_length":271}},"tags":[],"format_contract_version":"news_item_formats.v1"}}}