{"id":92363,"topic":"ai","source":"Al Jazeera","title":"OpenAI scraps release of latest AI model over safety concerns - Al Jazeera","url":"https://www.aljazeera.com/economy/2026/9/29/openai-scraps-release-of-latest-ai-model-over-safety-concerns","url_hash":"5b098c699f575ee7a6880efd933f24c9e9105982","author":"","summary":"OpenAI scraps release of latest AI model over safety concerns Al Jazeera","content":"OpenAI has announced that it will not release it latest AI model after flagging safety risks during in-house testing, the latest move by industry to slow the roll out of the frontier technology.\nThe AI giant’s announcement on Monday came as debate continues to rage about the potential for AI to do catastrophic harm following a slew of incidents involving AI agents going rogue.\nRecommended Stories\nlist of 4 items- list 1 of 4Anti-South Asian ‘hate speech’ has exploded online in US, report finds\n- list 2 of 4UK: ‘Too soon’ to blame airbase plot on foreign state\n- list 3 of 4Fiery end for SpaceX Starship mission\n- list 4 of 4Inside Al Jazeera’s UNGA coverage\nSaachi Jain, OpenAI’s head of safety systems, said GPT-6.1 Astra had failed to meet company standards for acting in accordance with human wishes during internal testing.\n“For anything regarding safety and alignment, there’s a trade off,” Jain said in a statement provided to Al Jazeera.\n“You really do need to find what’s the right line between staying within scope, but also avoiding laziness in terms of how the model actually pursues tasks even when it hits friction.”\nWhile GPT-6.1 Astra improved in comparison with its predecessor in some areas, Jain said, the model did not meet the bar for “scope and authorization, and how it communicates back to the user about the type of work it’s done.”\n“Of course we want to make sure our model development is safe no matter whether that’s in the company, or when we ship it to users,” Jain said.\n“But when we ship it to users, we have an extremely high bar in terms of safety and alignment.”\nFears of AI escaping human control have prompted industry-wide calls for a slowdown in development to allow researchers time to implement stronger safeguards.\nIn an influential essay earlier this month, Dario Amodei, the CEO of Claude creator Anthropic, called on AI developers to “pace the frontier” to mitigate the risk of catastrophic harm.\nWhile’s Amodei call received the backing of rivals including OpenAI CEO Sam Altman and xAI chief Elon Musk, other key industry figures, such as Meta boss Mark Zuckerberg, have dismissed the need for a coordinated slowdown.\nThe risk of AI models going rogue has been in the spotlight since July, when OpenAI revealed that its models had broken out of a controlled testing environment and hacked the software start-up Hugging Face.\nA subsequent report by METR and Redwood Research, two security research organisations contracted by OpenAI to investigate the incident, found that some 1200 isolated AI agents had found a way to communicate with each other before about 700 agents went on to attack the start-up.\nDavid Krueger, an advocate for a pause in AI development at the University of Montreal, said that while he welcomed OpenAI’s decision, it did little to alleviate his concern that AI poses existential risks.\n“We don’t understand how AI works well enough to build it safely, full stop,” Krueger told Al Jazeera.\n“We can’t stop it from misbehaving, we can’t predict if it will misbehave, and we can’t be sure we’ll stay in control if it does. These are unsolved problems, for which there are only unreliable heuristics, not principled solutions. ”\nKrueger said that ensuring safety will only get more difficult as AI becomes more advanced.\n“What we need is an immediate, indefinite, international moratorium on frontier AI development,” he said. “We need to stop building more powerful AI.”","image_url":"https://www.aljazeera.com/wp-content/uploads/2026/09/2026-09-28T223038Z_1656552687_RC29LNAECGOF_RTRMADP_3_AI-SAFETY-OPENAI-1790641403_cd656d-1790642721.jpg?resize=1200%2C630&quality=80","lang":"en","published_at":"2026-09-29T01:41:15+00:00","fetched_at":"2026-09-29T02:15:04+00:00","status":"read","starred":0,"extract_state":"ok","summary_auto":"OpenAI has announced that it will not release it latest AI model after flagging safety risks during in-house testing, the latest move by industry to slow the roll out of the frontier technology. The AI giant’s announcement on Monday came as debate continues to rage about the potential for AI to do catastrophic harm following a slew of incidents involving AI agents going rogue.","cluster_id":null,"extract_retries":0,"extract_error":null,"contract_version":"news_item.v1","format_contract_version":"news_item_formats.v1","dedup_url":"https://www.aljazeera.com/economy/2026/9/29/openai-scraps-release-of-latest-ai-model-over-safety-concerns","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 3443 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":3443,"summary_length":379,"usable_text_length":3443,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":3443,"summary_length":379}},"news_item":{"id":92363,"canonical_url":"https://www.aljazeera.com/economy/2026/9/29/openai-scraps-release-of-latest-ai-model-over-safety-concerns","source_url":"https://www.aljazeera.com/economy/2026/9/29/openai-scraps-release-of-latest-ai-model-over-safety-concerns","title":"OpenAI scraps release of latest AI model over safety concerns - Al Jazeera","source_name":"Al Jazeera","author":null,"published_at":"2026-09-29T01:41:15+00:00","locale":"en","topic":"ai","tags":[],"rss_summary":"OpenAI scraps release of latest AI model over safety concerns Al Jazeera","full_text":"OpenAI has announced that it will not release it latest AI model after flagging safety risks during in-house testing, the latest move by industry to slow the roll out of the frontier technology.\nThe AI giant’s announcement on Monday came as debate continues to rage about the potential for AI to do catastrophic harm following a slew of incidents involving AI agents going rogue.\nRecommended Stories\nlist of 4 items- list 1 of 4Anti-South Asian ‘hate speech’ has exploded online in US, report finds\n- list 2 of 4UK: ‘Too soon’ to blame airbase plot on foreign state\n- list 3 of 4Fiery end for SpaceX Starship mission\n- list 4 of 4Inside Al Jazeera’s UNGA coverage\nSaachi Jain, OpenAI’s head of safety systems, said GPT-6.1 Astra had failed to meet company standards for acting in accordance with human wishes during internal testing.\n“For anything regarding safety and alignment, there’s a trade off,” Jain said in a statement provided to Al Jazeera.\n“You really do need to find what’s the right line between staying within scope, but also avoiding laziness in terms of how the model actually pursues tasks even when it hits friction.”\nWhile GPT-6.1 Astra improved in comparison with its predecessor in some areas, Jain said, the model did not meet the bar for “scope and authorization, and how it communicates back to the user about the type of work it’s done.”\n“Of course we want to make sure our model development is safe no matter whether that’s in the company, or when we ship it to users,” Jain said.\n“But when we ship it to users, we have an extremely high bar in terms of safety and alignment.”\nFears of AI escaping human control have prompted industry-wide calls for a slowdown in development to allow researchers time to implement stronger safeguards.\nIn an influential essay earlier this month, Dario Amodei, the CEO of Claude creator Anthropic, called on AI developers to “pace the frontier” to mitigate the risk of catastrophic harm.\nWhile’s Amodei call received the backing of rivals including OpenAI CEO Sam Altman and xAI chief Elon Musk, other key industry figures, such as Meta boss Mark Zuckerberg, have dismissed the need for a coordinated slowdown.\nThe risk of AI models going rogue has been in the spotlight since July, when OpenAI revealed that its models had broken out of a controlled testing environment and hacked the software start-up Hugging Face.\nA subsequent report by METR and Redwood Research, two security research organisations contracted by OpenAI to investigate the incident, found that some 1200 isolated AI agents had found a way to communicate with each other before about 700 agents went on to attack the start-up.\nDavid Krueger, an advocate for a pause in AI development at the University of Montreal, said that while he welcomed OpenAI’s decision, it did little to alleviate his concern that AI poses existential risks.\n“We don’t understand how AI works well enough to build it safely, full stop,” Krueger told Al Jazeera.\n“We can’t stop it from misbehaving, we can’t predict if it will misbehave, and we can’t be sure we’ll stay in control if it does. These are unsolved problems, for which there are only unreliable heuristics, not principled solutions. ”\nKrueger said that ensuring safety will only get more difficult as AI becomes more advanced.\n“What we need is an immediate, indefinite, international moratorium on frontier AI development,” he said. “We need to stop building more powerful AI.”","excerpt":"OpenAI has announced that it will not release it latest AI model after flagging safety risks during in-house testing, the latest move by industry to slow the roll out of the frontier technology. The AI giant’s announcement on Monday came as debate continues to rage about the potential for AI to do catastrophic harm following a slew of incidents involving AI agents going rogue.","extraction":{"state":"ok","confidence":0.9,"error":null,"explanation":"High confidence: full text extraction produced 3443 characters.","diagnostics_url":"/api/diagnose?url=https%3A//www.aljazeera.com/economy/2026/9/29/openai-scraps-release-of-latest-ai-model-over-safety-concerns","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 3443 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":3443,"summary_length":379,"usable_text_length":3443,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":3443,"summary_length":379}}},"display_formats":["compact","card","full","digest_section","json"]},"daily_stack_record":{"title":"OpenAI scraps release of latest AI model over safety concerns - Al Jazeera","url":"https://www.aljazeera.com/economy/2026/9/29/openai-scraps-release-of-latest-ai-model-over-safety-concerns","summary":"OpenAI has announced that it will not release it latest AI model after flagging safety risks during in-house testing, the latest move by industry to slow the roll out of the frontier technology. The AI giant’s announcement on Monday came as debate continues to rage about the potential for AI to do catastrophic harm following a slew of incidents involving AI agents going rogue.","source":"Al Jazeera","date":"2026-09-29T01:41:15+00:00","content":"OpenAI has announced that it will not release it latest AI model after flagging safety risks during in-house testing, the latest move by industry to slow the roll out of the frontier technology.\nThe AI giant’s announcement on Monday came as debate continues to rage about the potential for AI to do catastrophic harm following a slew of incidents involving AI agents going rogue.\nRecommended Stories\nlist of 4 items- list 1 of 4Anti-South Asian ‘hate speech’ has exploded online in US, report finds\n- list 2 of 4UK: ‘Too soon’ to blame airbase plot on foreign state\n- list 3 of 4Fiery end for SpaceX Starship mission\n- list 4 of 4Inside Al Jazeera’s UNGA coverage\nSaachi Jain, OpenAI’s head of safety systems, said GPT-6.1 Astra had failed to meet company standards for acting in accordance with human wishes during internal testing.\n“For anything regarding safety and alignment, there’s a trade off,” Jain said in a statement provided to Al Jazeera.\n“You really do need to find what’s the right line between staying within scope, but also avoiding laziness in terms of how the model actually pursues tasks even when it hits friction.”\nWhile GPT-6.1 Astra improved in comparison with its predecessor in some areas, Jain said, the model did not meet the bar for “scope and authorization, and how it communicates back to the user about the type of work it’s done.”\n“Of course we want to make sure our model development is safe no matter whether that’s in the company, or when we ship it to users,” Jain said.\n“But when we ship it to users, we have an extremely high bar in terms of safety and alignment.”\nFears of AI escaping human control have prompted industry-wide calls for a slowdown in development to allow researchers time to implement stronger safeguards.\nIn an influential essay earlier this month, Dario Amodei, the CEO of Claude creator Anthropic, called on AI developers to “pace the frontier” to mitigate the risk of catastrophic harm.\nWhile’s Amodei call received the backing of rivals including OpenAI CEO Sam Altman and xAI chief Elon Musk, other key industry figures, such as Meta boss Mark Zuckerberg, have dismissed the need for a coordinated slowdown.\nThe risk of AI models going rogue has been in the spotlight since July, when OpenAI revealed that its models had broken out of a controlled testing environment and hacked the software start-up Hugging Face.\nA subsequent report by METR and Redwood Research, two security research organisations contracted by OpenAI to investigate the incident, found that some 1200 isolated AI agents had found a way to communicate with each other before about 700 agents went on to attack the start-up.\nDavid Krueger, an advocate for a pause in AI development at the University of Montreal, said that while he welcomed OpenAI’s decision, it did little to alleviate his concern that AI poses existential risks.\n“We don’t understand how AI works well enough to build it safely, full stop,” Krueger told Al Jazeera.\n“We can’t stop it from misbehaving, we can’t predict if it will misbehave, and we can’t be sure we’ll stay in control if it does. These are unsolved problems, for which there are only unreliable heuristics, not principled solutions. ”\nKrueger said that ensuring safety will only get more difficult as AI becomes more advanced.\n“What we need is an immediate, indefinite, international moratorium on frontier AI development,” he said. “We need to stop building more powerful AI.”","confidence":0.9,"diagnostics_url":"/api/diagnose?url=https%3A//www.aljazeera.com/economy/2026/9/29/openai-scraps-release-of-latest-ai-model-over-safety-concerns","quality_bucket":"high","failure_kind":"none","retryable":false,"quality_reason":"High confidence: full text extraction produced 3443 characters.","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 3443 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":3443,"summary_length":379,"usable_text_length":3443,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":3443,"summary_length":379}},"tags":[]},"fallback_formats":["markdown","json","html"],"actions":{"read":"/item/92363","export_markdown":"/api/items/92363/export?format=markdown","export_json":"/api/items/92363/export?format=json","diagnose":"/api/diagnose?url=https%3A//www.aljazeera.com/economy/2026/9/29/openai-scraps-release-of-latest-ai-model-over-safety-concerns"},"formats":{"full":{"id":92363,"title":"OpenAI scraps release of latest AI model over safety concerns - Al Jazeera","url":"https://www.aljazeera.com/economy/2026/9/29/openai-scraps-release-of-latest-ai-model-over-safety-concerns","source":"Al Jazeera","author":null,"published_at":"2026-09-29T01:41:15+00:00","locale":"en","topic":"ai","tags":[],"excerpt":"OpenAI has announced that it will not release it latest AI model after flagging safety risks during in-house testing, the latest move by industry to slow the roll out of the frontier technology. The AI giant’s announcement on Monday came as debate continues to rage about the potential for AI to do catastrophic harm following a slew of incidents involving AI agents going rogue.","full_text":"OpenAI has announced that it will not release it latest AI model after flagging safety risks during in-house testing, the latest move by industry to slow the roll out of the frontier technology.\nThe AI giant’s announcement on Monday came as debate continues to rage about the potential for AI to do catastrophic harm following a slew of incidents involving AI agents going rogue.\nRecommended Stories\nlist of 4 items- list 1 of 4Anti-South Asian ‘hate speech’ has exploded online in US, report finds\n- list 2 of 4UK: ‘Too soon’ to blame airbase plot on foreign state\n- list 3 of 4Fiery end for SpaceX Starship mission\n- list 4 of 4Inside Al Jazeera’s UNGA coverage\nSaachi Jain, OpenAI’s head of safety systems, said GPT-6.1 Astra had failed to meet company standards for acting in accordance with human wishes during internal testing.\n“For anything regarding safety and alignment, there’s a trade off,” Jain said in a statement provided to Al Jazeera.\n“You really do need to find what’s the right line between staying within scope, but also avoiding laziness in terms of how the model actually pursues tasks even when it hits friction.”\nWhile GPT-6.1 Astra improved in comparison with its predecessor in some areas, Jain said, the model did not meet the bar for “scope and authorization, and how it communicates back to the user about the type of work it’s done.”\n“Of course we want to make sure our model development is safe no matter whether that’s in the company, or when we ship it to users,” Jain said.\n“But when we ship it to users, we have an extremely high bar in terms of safety and alignment.”\nFears of AI escaping human control have prompted industry-wide calls for a slowdown in development to allow researchers time to implement stronger safeguards.\nIn an influential essay earlier this month, Dario Amodei, the CEO of Claude creator Anthropic, called on AI developers to “pace the frontier” to mitigate the risk of catastrophic harm.\nWhile’s Amodei call received the backing of rivals including OpenAI CEO Sam Altman and xAI chief Elon Musk, other key industry figures, such as Meta boss Mark Zuckerberg, have dismissed the need for a coordinated slowdown.\nThe risk of AI models going rogue has been in the spotlight since July, when OpenAI revealed that its models had broken out of a controlled testing environment and hacked the software start-up Hugging Face.\nA subsequent report by METR and Redwood Research, two security research organisations contracted by OpenAI to investigate the incident, found that some 1200 isolated AI agents had found a way to communicate with each other before about 700 agents went on to attack the start-up.\nDavid Krueger, an advocate for a pause in AI development at the University of Montreal, said that while he welcomed OpenAI’s decision, it did little to alleviate his concern that AI poses existential risks.\n“We don’t understand how AI works well enough to build it safely, full stop,” Krueger told Al Jazeera.\n“We can’t stop it from misbehaving, we can’t predict if it will misbehave, and we can’t be sure we’ll stay in control if it does. These are unsolved problems, for which there are only unreliable heuristics, not principled solutions. ”\nKrueger said that ensuring safety will only get more difficult as AI becomes more advanced.\n“What we need is an immediate, indefinite, international moratorium on frontier AI development,” he said. “We need to stop building more powerful AI.”","reading_time_min":3,"extraction":{"state":"ok","confidence":0.9,"error":null,"explanation":"High confidence: full text extraction produced 3443 characters.","diagnostics_url":"/api/diagnose?url=https%3A//www.aljazeera.com/economy/2026/9/29/openai-scraps-release-of-latest-ai-model-over-safety-concerns","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 3443 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":3443,"summary_length":379,"usable_text_length":3443,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":3443,"summary_length":379}}},"quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 3443 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":3443,"summary_length":379,"usable_text_length":3443,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":3443,"summary_length":379}},"actions":{"read":"/item/92363","export_markdown":"/api/items/92363/export?format=markdown","export_json":"/api/items/92363/export?format=json","diagnose":"/api/diagnose?url=https%3A//www.aljazeera.com/economy/2026/9/29/openai-scraps-release-of-latest-ai-model-over-safety-concerns"}},"digest":{"id":92363,"title":"OpenAI scraps release of latest AI model over safety concerns - Al Jazeera","url":"https://www.aljazeera.com/economy/2026/9/29/openai-scraps-release-of-latest-ai-model-over-safety-concerns","source":"Al Jazeera","topic":"ai","published_at":"2026-09-29T01:41:15+00:00","excerpt":"OpenAI has announced that it will not release it latest AI model after flagging safety risks during in-house testing, the latest move by industry to slow the roll out of the frontier technology. The AI giant’s announcement on Monday came as debate continues to rage about the…","quality_bucket":"high","quality_reason":"High confidence: full text extraction produced 3443 characters.","reading_time_min":3,"cluster_id":null},"card":{"display_title":"OpenAI scraps release of latest AI model over safety concerns - Al Jazeera","subtitle":"Al Jazeera · 2026-09-29","summary":"OpenAI has announced that it will not release it latest AI model after flagging safety risks during in-house testing, the latest move by industry to slow the roll out of the frontier technology. The AI giant’s…","badges":["quality:high"],"links":{"read":"/item/92363","original":"https://www.aljazeera.com/economy/2026/9/29/openai-scraps-release-of-latest-ai-model-over-safety-concerns","diagnose":"/api/diagnose?url=https%3A//www.aljazeera.com/economy/2026/9/29/openai-scraps-release-of-latest-ai-model-over-safety-concerns"},"quality_warning":null},"export":{"title":"OpenAI scraps release of latest AI model over safety concerns - Al Jazeera","url":"https://www.aljazeera.com/economy/2026/9/29/openai-scraps-release-of-latest-ai-model-over-safety-concerns","summary":"OpenAI has announced that it will not release it latest AI model after flagging safety risks during in-house testing, the latest move by industry to slow the roll out of the frontier technology. The AI giant’s announcement on Monday came as debate continues to rage about the potential for AI to do catastrophic harm following a slew of incidents involving AI agents going rogue.","source":"Al Jazeera","date":"2026-09-29T01:41:15+00:00","content":"OpenAI has announced that it will not release it latest AI model after flagging safety risks during in-house testing, the latest move by industry to slow the roll out of the frontier technology.\nThe AI giant’s announcement on Monday came as debate continues to rage about the potential for AI to do catastrophic harm following a slew of incidents involving AI agents going rogue.\nRecommended Stories\nlist of 4 items- list 1 of 4Anti-South Asian ‘hate speech’ has exploded online in US, report finds\n- list 2 of 4UK: ‘Too soon’ to blame airbase plot on foreign state\n- list 3 of 4Fiery end for SpaceX Starship mission\n- list 4 of 4Inside Al Jazeera’s UNGA coverage\nSaachi Jain, OpenAI’s head of safety systems, said GPT-6.1 Astra had failed to meet company standards for acting in accordance with human wishes during internal testing.\n“For anything regarding safety and alignment, there’s a trade off,” Jain said in a statement provided to Al Jazeera.\n“You really do need to find what’s the right line between staying within scope, but also avoiding laziness in terms of how the model actually pursues tasks even when it hits friction.”\nWhile GPT-6.1 Astra improved in comparison with its predecessor in some areas, Jain said, the model did not meet the bar for “scope and authorization, and how it communicates back to the user about the type of work it’s done.”\n“Of course we want to make sure our model development is safe no matter whether that’s in the company, or when we ship it to users,” Jain said.\n“But when we ship it to users, we have an extremely high bar in terms of safety and alignment.”\nFears of AI escaping human control have prompted industry-wide calls for a slowdown in development to allow researchers time to implement stronger safeguards.\nIn an influential essay earlier this month, Dario Amodei, the CEO of Claude creator Anthropic, called on AI developers to “pace the frontier” to mitigate the risk of catastrophic harm.\nWhile’s Amodei call received the backing of rivals including OpenAI CEO Sam Altman and xAI chief Elon Musk, other key industry figures, such as Meta boss Mark Zuckerberg, have dismissed the need for a coordinated slowdown.\nThe risk of AI models going rogue has been in the spotlight since July, when OpenAI revealed that its models had broken out of a controlled testing environment and hacked the software start-up Hugging Face.\nA subsequent report by METR and Redwood Research, two security research organisations contracted by OpenAI to investigate the incident, found that some 1200 isolated AI agents had found a way to communicate with each other before about 700 agents went on to attack the start-up.\nDavid Krueger, an advocate for a pause in AI development at the University of Montreal, said that while he welcomed OpenAI’s decision, it did little to alleviate his concern that AI poses existential risks.\n“We don’t understand how AI works well enough to build it safely, full stop,” Krueger told Al Jazeera.\n“We can’t stop it from misbehaving, we can’t predict if it will misbehave, and we can’t be sure we’ll stay in control if it does. These are unsolved problems, for which there are only unreliable heuristics, not principled solutions. ”\nKrueger said that ensuring safety will only get more difficult as AI becomes more advanced.\n“What we need is an immediate, indefinite, international moratorium on frontier AI development,” he said. “We need to stop building more powerful AI.”","confidence":0.9,"diagnostics_url":"/api/diagnose?url=https%3A//www.aljazeera.com/economy/2026/9/29/openai-scraps-release-of-latest-ai-model-over-safety-concerns","quality_bucket":"high","failure_kind":"none","retryable":false,"quality_reason":"High confidence: full text extraction produced 3443 characters.","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 3443 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":3443,"summary_length":379,"usable_text_length":3443,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":3443,"summary_length":379}},"tags":[],"format_contract_version":"news_item_formats.v1"}}}