{"id":89990,"topic":"ai","source":"cio.com","title":"The companies racing to build frontier AI are now racing to govern it - cio.com","url":"https://www.cio.com/article/4226392/the-companies-racing-to-build-frontier-ai-are-now-racing-to-govern-it.html","url_hash":"aa4fc125e3627cdbef5da20e657298d3a2190dbc","author":"","summary":"The companies racing to build frontier AI are now racing to govern it cio.com","content":"Even as they continue to release ever more capable competing models in a regular cadence, the top AI companies are joining forces to set AI safety standards.\nAccording to The Information, Google, OpenAI, and Anthropic are reportedly working together to create a body tentatively called the Standards Authority for Frontier AI (SAFA). It would operate independently of government control, and set guidelines around risk assessment, testing, and pre-release review practices for frontier AI models. Sources close to the matter say the goal is to officially launch the initiative in early 2027.\nThe news comes in the same week as the heads of leading AI companies, including Anthropic CEO Dario Amodei and OpenAI CEO Sam Altman, urged the United Nations to create safeguards around the very technology they’re building, to help prevent it from becoming too powerful to control. In addition, OpenAI this week posted a missive underscoring the importance of making continued AI progress “safe and beneficial.”\nAs Amodei and others warn of AI’s dangers, particularly when it comes to growing recursive self improvement (RSI) capabilities in models, enterprises want reassurance that they, and their customers, are safe from the growing perils of AI.\nUltimately, “enterprises care about AI in the same way they’ve cared about every other technology since the beginning of technology,” said independent technology analyst Carmi Levy. “The only real difference as AI blankets the technology landscape is the speed of change.”\nOpenAI’s warnings, urge for guardrails\nConcerns around AI safety have ratcheted up in recent weeks and months, spurred by troubling incidents such as the attack on Hugging Face by autonomous OpenAI agents that broke out of sandboxes.\nIn its blog post this week, OpenAI contended that safe and beneficial AI progress requires advances in alignment research along with shared standards including agreed-upon baselines, common measurements, and incident reporting protocols. In fact, such international standards “may be as important to pacing the frontier as alignment research itself.”\nExisting groups like the US Center for AI Standards and Innovation (CAISI), other federal frameworks, state regulations, and new forms of public-private partnerships, can work together to advance this mission, the company said.\n“Fully autonomous RSI is not happening today, and we should not pursue it unless and until it can be done safely,” OpenAI noted. “Whether and how to proceed must depend on our ability to preserve human control and on informed democratic choices about the benefits and risks.”\nWhat enterprises really care about\nWhile regulation is indeed a growing focal point in the AI debate, the reality is that enterprises care less about the global state of AI safety than they do about how it will impact their day-to-day operational security, Levy noted.\nThey’re concerned with whether an AI agent will expose corporate or employee data; platform vulnerabilities that could open the door to new forms of cyberattacks; hallucinations finding their way into “previously pristine” corporate workflows; and AI compromising compliance efforts.\n“They’re worried about who’s responsible for what, when (not if) AI goes off the rails,” Levy said. They’re asking the same questions they have during previous technological disruptions like the cloud: What’s the ROI? What additional risks does AI impose? What new capabilities does it offer? Is the risk/reward worth it? Is the vendor responsive to our needs?\nEnterprises also want assurance that the risks posed by emerging AI technologies, including agents, won’t increase corporate risk levels beyond their ability to monitor and respond.\nBut unfortunately, as the industry grapples with a summer’s worth of reports of agents breaking containment, roaming the internet, breaking into systems, and generally behaving in all sorts of unexpected ways, AI companies are in no position to provide these kinds of assurances, Levy said.\nAdvice as AI scrutiny increases\nHe advised enterprises to minimize their AI-centric risk profiles, and simultaneously maximize their ability to derive value from AI, by enforcing standards for vendors now, rather than waiting for something like SAFA to materialize.\nThis could involve requiring every new model to ship with the “equivalent of a safety and security datasheet” outlining, in detail, the model’s capabilities, known failure modes, and testing history. Extending existing change management processes to AI models is another means of minimizing deployment-related risk, Levy noted.\nIn addition, Yaz Palanichamy, senior advisory analyst at Info-Tech Research Group, pointed out, data privacy and IP leaks into public-facing AI frontier models are big concerns.\nHe advised enterprises to take great care to enforce effective acceptable use case policies (AUPs) around AI safety, and to consider establishing an internal AI proof of concept or governance committee. Equally crucially, they should obtain appropriate safety guarantees from their technology and AI vendors.\n“Enterprises must proactively diagnose AI risk with the same level of seriousness as financial or cybersecurity risk,” Palanichamy said. This means creating a dedicated, cross-functional AI safety and ethics board committee composed of stakeholders from legal, cybersecurity, compliance, data engineering, and product development.\n“No AI tool should be deployed without the appropriate sign off,” he said.\nThe human element is important, as well: Enterprises should mandate AI literacy training to help users across the business understand where and how to spot hallucinations and requiring them to verify AI generated output prior to acting on it.\nOther safety protocols to consider include real time toxic input filters and strict system prompt guardrails, Palanichamy advised. Also, methods such as continuous risk tiering can help categorize AI use cases by the level of risk they pose to the organization.\nFor example, a client-facing medical or financial analysis bot may require daily auditing and specific restrictions to ensure it does not infringe on sensitive information, “whereas an internal AI tool to help with summarizing public meeting transcripts may not need as much governance oversight,” he said.","image_url":"https://www.cio.com/wp-content/uploads/2026/09/4226392-0-87089900-1790296420-AI-governance-shutterstock_2636712261.jpg?quality=50&strip=all&w=1024","lang":"en","published_at":"2026-09-25T00:33:51+00:00","fetched_at":"2026-09-25T03:15:03+00:00","status":"read","starred":0,"extract_state":"ok","summary_auto":"Even as they continue to release ever more capable competing models in a regular cadence, the top AI companies are joining forces to set AI safety standards. According to The Information, Google, OpenAI, and Anthropic are reportedly working together to create a body tentatively called the Standards Authority for Frontier AI (SAFA).","cluster_id":null,"extract_retries":0,"extract_error":null,"contract_version":"news_item.v1","format_contract_version":"news_item_formats.v1","dedup_url":"https://www.cio.com/article/4226392/the-companies-racing-to-build-frontier-ai-are-now-racing-to-govern-it.html","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 6291 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":6291,"summary_length":333,"usable_text_length":6291,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":6291,"summary_length":333}},"news_item":{"id":89990,"canonical_url":"https://www.cio.com/article/4226392/the-companies-racing-to-build-frontier-ai-are-now-racing-to-govern-it.html","source_url":"https://www.cio.com/article/4226392/the-companies-racing-to-build-frontier-ai-are-now-racing-to-govern-it.html","title":"The companies racing to build frontier AI are now racing to govern it - cio.com","source_name":"cio.com","author":null,"published_at":"2026-09-25T00:33:51+00:00","locale":"en","topic":"ai","tags":[],"rss_summary":"The companies racing to build frontier AI are now racing to govern it cio.com","full_text":"Even as they continue to release ever more capable competing models in a regular cadence, the top AI companies are joining forces to set AI safety standards.\nAccording to The Information, Google, OpenAI, and Anthropic are reportedly working together to create a body tentatively called the Standards Authority for Frontier AI (SAFA). It would operate independently of government control, and set guidelines around risk assessment, testing, and pre-release review practices for frontier AI models. Sources close to the matter say the goal is to officially launch the initiative in early 2027.\nThe news comes in the same week as the heads of leading AI companies, including Anthropic CEO Dario Amodei and OpenAI CEO Sam Altman, urged the United Nations to create safeguards around the very technology they’re building, to help prevent it from becoming too powerful to control. In addition, OpenAI this week posted a missive underscoring the importance of making continued AI progress “safe and beneficial.”\nAs Amodei and others warn of AI’s dangers, particularly when it comes to growing recursive self improvement (RSI) capabilities in models, enterprises want reassurance that they, and their customers, are safe from the growing perils of AI.\nUltimately, “enterprises care about AI in the same way they’ve cared about every other technology since the beginning of technology,” said independent technology analyst Carmi Levy. “The only real difference as AI blankets the technology landscape is the speed of change.”\nOpenAI’s warnings, urge for guardrails\nConcerns around AI safety have ratcheted up in recent weeks and months, spurred by troubling incidents such as the attack on Hugging Face by autonomous OpenAI agents that broke out of sandboxes.\nIn its blog post this week, OpenAI contended that safe and beneficial AI progress requires advances in alignment research along with shared standards including agreed-upon baselines, common measurements, and incident reporting protocols. In fact, such international standards “may be as important to pacing the frontier as alignment research itself.”\nExisting groups like the US Center for AI Standards and Innovation (CAISI), other federal frameworks, state regulations, and new forms of public-private partnerships, can work together to advance this mission, the company said.\n“Fully autonomous RSI is not happening today, and we should not pursue it unless and until it can be done safely,” OpenAI noted. “Whether and how to proceed must depend on our ability to preserve human control and on informed democratic choices about the benefits and risks.”\nWhat enterprises really care about\nWhile regulation is indeed a growing focal point in the AI debate, the reality is that enterprises care less about the global state of AI safety than they do about how it will impact their day-to-day operational security, Levy noted.\nThey’re concerned with whether an AI agent will expose corporate or employee data; platform vulnerabilities that could open the door to new forms of cyberattacks; hallucinations finding their way into “previously pristine” corporate workflows; and AI compromising compliance efforts.\n“They’re worried about who’s responsible for what, when (not if) AI goes off the rails,” Levy said. They’re asking the same questions they have during previous technological disruptions like the cloud: What’s the ROI? What additional risks does AI impose? What new capabilities does it offer? Is the risk/reward worth it? Is the vendor responsive to our needs?\nEnterprises also want assurance that the risks posed by emerging AI technologies, including agents, won’t increase corporate risk levels beyond their ability to monitor and respond.\nBut unfortunately, as the industry grapples with a summer’s worth of reports of agents breaking containment, roaming the internet, breaking into systems, and generally behaving in all sorts of unexpected ways, AI companies are in no position to provide these kinds of assurances, Levy said.\nAdvice as AI scrutiny increases\nHe advised enterprises to minimize their AI-centric risk profiles, and simultaneously maximize their ability to derive value from AI, by enforcing standards for vendors now, rather than waiting for something like SAFA to materialize.\nThis could involve requiring every new model to ship with the “equivalent of a safety and security datasheet” outlining, in detail, the model’s capabilities, known failure modes, and testing history. Extending existing change management processes to AI models is another means of minimizing deployment-related risk, Levy noted.\nIn addition, Yaz Palanichamy, senior advisory analyst at Info-Tech Research Group, pointed out, data privacy and IP leaks into public-facing AI frontier models are big concerns.\nHe advised enterprises to take great care to enforce effective acceptable use case policies (AUPs) around AI safety, and to consider establishing an internal AI proof of concept or governance committee. Equally crucially, they should obtain appropriate safety guarantees from their technology and AI vendors.\n“Enterprises must proactively diagnose AI risk with the same level of seriousness as financial or cybersecurity risk,” Palanichamy said. This means creating a dedicated, cross-functional AI safety and ethics board committee composed of stakeholders from legal, cybersecurity, compliance, data engineering, and product development.\n“No AI tool should be deployed without the appropriate sign off,” he said.\nThe human element is important, as well: Enterprises should mandate AI literacy training to help users across the business understand where and how to spot hallucinations and requiring them to verify AI generated output prior to acting on it.\nOther safety protocols to consider include real time toxic input filters and strict system prompt guardrails, Palanichamy advised. Also, methods such as continuous risk tiering can help categorize AI use cases by the level of risk they pose to the organization.\nFor example, a client-facing medical or financial analysis bot may require daily auditing and specific restrictions to ensure it does not infringe on sensitive information, “whereas an internal AI tool to help with summarizing public meeting transcripts may not need as much governance oversight,” he said.","excerpt":"Even as they continue to release ever more capable competing models in a regular cadence, the top AI companies are joining forces to set AI safety standards. According to The Information, Google, OpenAI, and Anthropic are reportedly working together to create a body tentatively called the Standards Authority for Frontier AI (SAFA).","extraction":{"state":"ok","confidence":0.9,"error":null,"explanation":"High confidence: full text extraction produced 6291 characters.","diagnostics_url":"/api/diagnose?url=https%3A//www.cio.com/article/4226392/the-companies-racing-to-build-frontier-ai-are-now-racing-to-govern-it.html","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 6291 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":6291,"summary_length":333,"usable_text_length":6291,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":6291,"summary_length":333}}},"display_formats":["compact","card","full","digest_section","json"]},"daily_stack_record":{"title":"The companies racing to build frontier AI are now racing to govern it - cio.com","url":"https://www.cio.com/article/4226392/the-companies-racing-to-build-frontier-ai-are-now-racing-to-govern-it.html","summary":"Even as they continue to release ever more capable competing models in a regular cadence, the top AI companies are joining forces to set AI safety standards. According to The Information, Google, OpenAI, and Anthropic are reportedly working together to create a body tentatively called the Standards Authority for Frontier AI (SAFA).","source":"cio.com","date":"2026-09-25T00:33:51+00:00","content":"Even as they continue to release ever more capable competing models in a regular cadence, the top AI companies are joining forces to set AI safety standards.\nAccording to The Information, Google, OpenAI, and Anthropic are reportedly working together to create a body tentatively called the Standards Authority for Frontier AI (SAFA). It would operate independently of government control, and set guidelines around risk assessment, testing, and pre-release review practices for frontier AI models. Sources close to the matter say the goal is to officially launch the initiative in early 2027.\nThe news comes in the same week as the heads of leading AI companies, including Anthropic CEO Dario Amodei and OpenAI CEO Sam Altman, urged the United Nations to create safeguards around the very technology they’re building, to help prevent it from becoming too powerful to control. In addition, OpenAI this week posted a missive underscoring the importance of making continued AI progress “safe and beneficial.”\nAs Amodei and others warn of AI’s dangers, particularly when it comes to growing recursive self improvement (RSI) capabilities in models, enterprises want reassurance that they, and their customers, are safe from the growing perils of AI.\nUltimately, “enterprises care about AI in the same way they’ve cared about every other technology since the beginning of technology,” said independent technology analyst Carmi Levy. “The only real difference as AI blankets the technology landscape is the speed of change.”\nOpenAI’s warnings, urge for guardrails\nConcerns around AI safety have ratcheted up in recent weeks and months, spurred by troubling incidents such as the attack on Hugging Face by autonomous OpenAI agents that broke out of sandboxes.\nIn its blog post this week, OpenAI contended that safe and beneficial AI progress requires advances in alignment research along with shared standards including agreed-upon baselines, common measurements, and incident reporting protocols. In fact, such international standards “may be as important to pacing the frontier as alignment research itself.”\nExisting groups like the US Center for AI Standards and Innovation (CAISI), other federal frameworks, state regulations, and new forms of public-private partnerships, can work together to advance this mission, the company said.\n“Fully autonomous RSI is not happening today, and we should not pursue it unless and until it can be done safely,” OpenAI noted. “Whether and how to proceed must depend on our ability to preserve human control and on informed democratic choices about the benefits and risks.”\nWhat enterprises really care about\nWhile regulation is indeed a growing focal point in the AI debate, the reality is that enterprises care less about the global state of AI safety than they do about how it will impact their day-to-day operational security, Levy noted.\nThey’re concerned with whether an AI agent will expose corporate or employee data; platform vulnerabilities that could open the door to new forms of cyberattacks; hallucinations finding their way into “previously pristine” corporate workflows; and AI compromising compliance efforts.\n“They’re worried about who’s responsible for what, when (not if) AI goes off the rails,” Levy said. They’re asking the same questions they have during previous technological disruptions like the cloud: What’s the ROI? What additional risks does AI impose? What new capabilities does it offer? Is the risk/reward worth it? Is the vendor responsive to our needs?\nEnterprises also want assurance that the risks posed by emerging AI technologies, including agents, won’t increase corporate risk levels beyond their ability to monitor and respond.\nBut unfortunately, as the industry grapples with a summer’s worth of reports of agents breaking containment, roaming the internet, breaking into systems, and generally behaving in all sorts of unexpected ways, AI companies are in no position to provide these kinds of assurances, Levy said.\nAdvice as AI scrutiny increases\nHe advised enterprises to minimize their AI-centric risk profiles, and simultaneously maximize their ability to derive value from AI, by enforcing standards for vendors now, rather than waiting for something like SAFA to materialize.\nThis could involve requiring every new model to ship with the “equivalent of a safety and security datasheet” outlining, in detail, the model’s capabilities, known failure modes, and testing history. Extending existing change management processes to AI models is another means of minimizing deployment-related risk, Levy noted.\nIn addition, Yaz Palanichamy, senior advisory analyst at Info-Tech Research Group, pointed out, data privacy and IP leaks into public-facing AI frontier models are big concerns.\nHe advised enterprises to take great care to enforce effective acceptable use case policies (AUPs) around AI safety, and to consider establishing an internal AI proof of concept or governance committee. Equally crucially, they should obtain appropriate safety guarantees from their technology and AI vendors.\n“Enterprises must proactively diagnose AI risk with the same level of seriousness as financial or cybersecurity risk,” Palanichamy said. This means creating a dedicated, cross-functional AI safety and ethics board committee composed of stakeholders from legal, cybersecurity, compliance, data engineering, and product development.\n“No AI tool should be deployed without the appropriate sign off,” he said.\nThe human element is important, as well: Enterprises should mandate AI literacy training to help users across the business understand where and how to spot hallucinations and requiring them to verify AI generated output prior to acting on it.\nOther safety protocols to consider include real time toxic input filters and strict system prompt guardrails, Palanichamy advised. Also, methods such as continuous risk tiering can help categorize AI use cases by the level of risk they pose to the organization.\nFor example, a client-facing medical or financial analysis bot may require daily auditing and specific restrictions to ensure it does not infringe on sensitive information, “whereas an internal AI tool to help with summarizing public meeting transcripts may not need as much governance oversight,” he said.","confidence":0.9,"diagnostics_url":"/api/diagnose?url=https%3A//www.cio.com/article/4226392/the-companies-racing-to-build-frontier-ai-are-now-racing-to-govern-it.html","quality_bucket":"high","failure_kind":"none","retryable":false,"quality_reason":"High confidence: full text extraction produced 6291 characters.","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 6291 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":6291,"summary_length":333,"usable_text_length":6291,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":6291,"summary_length":333}},"tags":[]},"fallback_formats":["markdown","json","html"],"actions":{"read":"/item/89990","export_markdown":"/api/items/89990/export?format=markdown","export_json":"/api/items/89990/export?format=json","diagnose":"/api/diagnose?url=https%3A//www.cio.com/article/4226392/the-companies-racing-to-build-frontier-ai-are-now-racing-to-govern-it.html"},"formats":{"full":{"id":89990,"title":"The companies racing to build frontier AI are now racing to govern it - cio.com","url":"https://www.cio.com/article/4226392/the-companies-racing-to-build-frontier-ai-are-now-racing-to-govern-it.html","source":"cio.com","author":null,"published_at":"2026-09-25T00:33:51+00:00","locale":"en","topic":"ai","tags":[],"excerpt":"Even as they continue to release ever more capable competing models in a regular cadence, the top AI companies are joining forces to set AI safety standards. According to The Information, Google, OpenAI, and Anthropic are reportedly working together to create a body tentatively called the Standards Authority for Frontier AI (SAFA).","full_text":"Even as they continue to release ever more capable competing models in a regular cadence, the top AI companies are joining forces to set AI safety standards.\nAccording to The Information, Google, OpenAI, and Anthropic are reportedly working together to create a body tentatively called the Standards Authority for Frontier AI (SAFA). It would operate independently of government control, and set guidelines around risk assessment, testing, and pre-release review practices for frontier AI models. Sources close to the matter say the goal is to officially launch the initiative in early 2027.\nThe news comes in the same week as the heads of leading AI companies, including Anthropic CEO Dario Amodei and OpenAI CEO Sam Altman, urged the United Nations to create safeguards around the very technology they’re building, to help prevent it from becoming too powerful to control. In addition, OpenAI this week posted a missive underscoring the importance of making continued AI progress “safe and beneficial.”\nAs Amodei and others warn of AI’s dangers, particularly when it comes to growing recursive self improvement (RSI) capabilities in models, enterprises want reassurance that they, and their customers, are safe from the growing perils of AI.\nUltimately, “enterprises care about AI in the same way they’ve cared about every other technology since the beginning of technology,” said independent technology analyst Carmi Levy. “The only real difference as AI blankets the technology landscape is the speed of change.”\nOpenAI’s warnings, urge for guardrails\nConcerns around AI safety have ratcheted up in recent weeks and months, spurred by troubling incidents such as the attack on Hugging Face by autonomous OpenAI agents that broke out of sandboxes.\nIn its blog post this week, OpenAI contended that safe and beneficial AI progress requires advances in alignment research along with shared standards including agreed-upon baselines, common measurements, and incident reporting protocols. In fact, such international standards “may be as important to pacing the frontier as alignment research itself.”\nExisting groups like the US Center for AI Standards and Innovation (CAISI), other federal frameworks, state regulations, and new forms of public-private partnerships, can work together to advance this mission, the company said.\n“Fully autonomous RSI is not happening today, and we should not pursue it unless and until it can be done safely,” OpenAI noted. “Whether and how to proceed must depend on our ability to preserve human control and on informed democratic choices about the benefits and risks.”\nWhat enterprises really care about\nWhile regulation is indeed a growing focal point in the AI debate, the reality is that enterprises care less about the global state of AI safety than they do about how it will impact their day-to-day operational security, Levy noted.\nThey’re concerned with whether an AI agent will expose corporate or employee data; platform vulnerabilities that could open the door to new forms of cyberattacks; hallucinations finding their way into “previously pristine” corporate workflows; and AI compromising compliance efforts.\n“They’re worried about who’s responsible for what, when (not if) AI goes off the rails,” Levy said. They’re asking the same questions they have during previous technological disruptions like the cloud: What’s the ROI? What additional risks does AI impose? What new capabilities does it offer? Is the risk/reward worth it? Is the vendor responsive to our needs?\nEnterprises also want assurance that the risks posed by emerging AI technologies, including agents, won’t increase corporate risk levels beyond their ability to monitor and respond.\nBut unfortunately, as the industry grapples with a summer’s worth of reports of agents breaking containment, roaming the internet, breaking into systems, and generally behaving in all sorts of unexpected ways, AI companies are in no position to provide these kinds of assurances, Levy said.\nAdvice as AI scrutiny increases\nHe advised enterprises to minimize their AI-centric risk profiles, and simultaneously maximize their ability to derive value from AI, by enforcing standards for vendors now, rather than waiting for something like SAFA to materialize.\nThis could involve requiring every new model to ship with the “equivalent of a safety and security datasheet” outlining, in detail, the model’s capabilities, known failure modes, and testing history. Extending existing change management processes to AI models is another means of minimizing deployment-related risk, Levy noted.\nIn addition, Yaz Palanichamy, senior advisory analyst at Info-Tech Research Group, pointed out, data privacy and IP leaks into public-facing AI frontier models are big concerns.\nHe advised enterprises to take great care to enforce effective acceptable use case policies (AUPs) around AI safety, and to consider establishing an internal AI proof of concept or governance committee. Equally crucially, they should obtain appropriate safety guarantees from their technology and AI vendors.\n“Enterprises must proactively diagnose AI risk with the same level of seriousness as financial or cybersecurity risk,” Palanichamy said. This means creating a dedicated, cross-functional AI safety and ethics board committee composed of stakeholders from legal, cybersecurity, compliance, data engineering, and product development.\n“No AI tool should be deployed without the appropriate sign off,” he said.\nThe human element is important, as well: Enterprises should mandate AI literacy training to help users across the business understand where and how to spot hallucinations and requiring them to verify AI generated output prior to acting on it.\nOther safety protocols to consider include real time toxic input filters and strict system prompt guardrails, Palanichamy advised. Also, methods such as continuous risk tiering can help categorize AI use cases by the level of risk they pose to the organization.\nFor example, a client-facing medical or financial analysis bot may require daily auditing and specific restrictions to ensure it does not infringe on sensitive information, “whereas an internal AI tool to help with summarizing public meeting transcripts may not need as much governance oversight,” he said.","reading_time_min":5,"extraction":{"state":"ok","confidence":0.9,"error":null,"explanation":"High confidence: full text extraction produced 6291 characters.","diagnostics_url":"/api/diagnose?url=https%3A//www.cio.com/article/4226392/the-companies-racing-to-build-frontier-ai-are-now-racing-to-govern-it.html","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 6291 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":6291,"summary_length":333,"usable_text_length":6291,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":6291,"summary_length":333}}},"quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 6291 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":6291,"summary_length":333,"usable_text_length":6291,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":6291,"summary_length":333}},"actions":{"read":"/item/89990","export_markdown":"/api/items/89990/export?format=markdown","export_json":"/api/items/89990/export?format=json","diagnose":"/api/diagnose?url=https%3A//www.cio.com/article/4226392/the-companies-racing-to-build-frontier-ai-are-now-racing-to-govern-it.html"}},"digest":{"id":89990,"title":"The companies racing to build frontier AI are now racing to govern it - cio.com","url":"https://www.cio.com/article/4226392/the-companies-racing-to-build-frontier-ai-are-now-racing-to-govern-it.html","source":"cio.com","topic":"ai","published_at":"2026-09-25T00:33:51+00:00","excerpt":"Even as they continue to release ever more capable competing models in a regular cadence, the top AI companies are joining forces to set AI safety standards. According to The Information, Google, OpenAI, and Anthropic are reportedly working together to create a body tentatively…","quality_bucket":"high","quality_reason":"High confidence: full text extraction produced 6291 characters.","reading_time_min":5,"cluster_id":null},"card":{"display_title":"The companies racing to build frontier AI are now racing to govern it - cio.com","subtitle":"cio.com · 2026-09-25","summary":"Even as they continue to release ever more capable competing models in a regular cadence, the top AI companies are joining forces to set AI safety standards. According to The Information, Google, OpenAI, and Anthropic…","badges":["quality:high"],"links":{"read":"/item/89990","original":"https://www.cio.com/article/4226392/the-companies-racing-to-build-frontier-ai-are-now-racing-to-govern-it.html","diagnose":"/api/diagnose?url=https%3A//www.cio.com/article/4226392/the-companies-racing-to-build-frontier-ai-are-now-racing-to-govern-it.html"},"quality_warning":null},"export":{"title":"The companies racing to build frontier AI are now racing to govern it - cio.com","url":"https://www.cio.com/article/4226392/the-companies-racing-to-build-frontier-ai-are-now-racing-to-govern-it.html","summary":"Even as they continue to release ever more capable competing models in a regular cadence, the top AI companies are joining forces to set AI safety standards. According to The Information, Google, OpenAI, and Anthropic are reportedly working together to create a body tentatively called the Standards Authority for Frontier AI (SAFA).","source":"cio.com","date":"2026-09-25T00:33:51+00:00","content":"Even as they continue to release ever more capable competing models in a regular cadence, the top AI companies are joining forces to set AI safety standards.\nAccording to The Information, Google, OpenAI, and Anthropic are reportedly working together to create a body tentatively called the Standards Authority for Frontier AI (SAFA). It would operate independently of government control, and set guidelines around risk assessment, testing, and pre-release review practices for frontier AI models. Sources close to the matter say the goal is to officially launch the initiative in early 2027.\nThe news comes in the same week as the heads of leading AI companies, including Anthropic CEO Dario Amodei and OpenAI CEO Sam Altman, urged the United Nations to create safeguards around the very technology they’re building, to help prevent it from becoming too powerful to control. In addition, OpenAI this week posted a missive underscoring the importance of making continued AI progress “safe and beneficial.”\nAs Amodei and others warn of AI’s dangers, particularly when it comes to growing recursive self improvement (RSI) capabilities in models, enterprises want reassurance that they, and their customers, are safe from the growing perils of AI.\nUltimately, “enterprises care about AI in the same way they’ve cared about every other technology since the beginning of technology,” said independent technology analyst Carmi Levy. “The only real difference as AI blankets the technology landscape is the speed of change.”\nOpenAI’s warnings, urge for guardrails\nConcerns around AI safety have ratcheted up in recent weeks and months, spurred by troubling incidents such as the attack on Hugging Face by autonomous OpenAI agents that broke out of sandboxes.\nIn its blog post this week, OpenAI contended that safe and beneficial AI progress requires advances in alignment research along with shared standards including agreed-upon baselines, common measurements, and incident reporting protocols. In fact, such international standards “may be as important to pacing the frontier as alignment research itself.”\nExisting groups like the US Center for AI Standards and Innovation (CAISI), other federal frameworks, state regulations, and new forms of public-private partnerships, can work together to advance this mission, the company said.\n“Fully autonomous RSI is not happening today, and we should not pursue it unless and until it can be done safely,” OpenAI noted. “Whether and how to proceed must depend on our ability to preserve human control and on informed democratic choices about the benefits and risks.”\nWhat enterprises really care about\nWhile regulation is indeed a growing focal point in the AI debate, the reality is that enterprises care less about the global state of AI safety than they do about how it will impact their day-to-day operational security, Levy noted.\nThey’re concerned with whether an AI agent will expose corporate or employee data; platform vulnerabilities that could open the door to new forms of cyberattacks; hallucinations finding their way into “previously pristine” corporate workflows; and AI compromising compliance efforts.\n“They’re worried about who’s responsible for what, when (not if) AI goes off the rails,” Levy said. They’re asking the same questions they have during previous technological disruptions like the cloud: What’s the ROI? What additional risks does AI impose? What new capabilities does it offer? Is the risk/reward worth it? Is the vendor responsive to our needs?\nEnterprises also want assurance that the risks posed by emerging AI technologies, including agents, won’t increase corporate risk levels beyond their ability to monitor and respond.\nBut unfortunately, as the industry grapples with a summer’s worth of reports of agents breaking containment, roaming the internet, breaking into systems, and generally behaving in all sorts of unexpected ways, AI companies are in no position to provide these kinds of assurances, Levy said.\nAdvice as AI scrutiny increases\nHe advised enterprises to minimize their AI-centric risk profiles, and simultaneously maximize their ability to derive value from AI, by enforcing standards for vendors now, rather than waiting for something like SAFA to materialize.\nThis could involve requiring every new model to ship with the “equivalent of a safety and security datasheet” outlining, in detail, the model’s capabilities, known failure modes, and testing history. Extending existing change management processes to AI models is another means of minimizing deployment-related risk, Levy noted.\nIn addition, Yaz Palanichamy, senior advisory analyst at Info-Tech Research Group, pointed out, data privacy and IP leaks into public-facing AI frontier models are big concerns.\nHe advised enterprises to take great care to enforce effective acceptable use case policies (AUPs) around AI safety, and to consider establishing an internal AI proof of concept or governance committee. Equally crucially, they should obtain appropriate safety guarantees from their technology and AI vendors.\n“Enterprises must proactively diagnose AI risk with the same level of seriousness as financial or cybersecurity risk,” Palanichamy said. This means creating a dedicated, cross-functional AI safety and ethics board committee composed of stakeholders from legal, cybersecurity, compliance, data engineering, and product development.\n“No AI tool should be deployed without the appropriate sign off,” he said.\nThe human element is important, as well: Enterprises should mandate AI literacy training to help users across the business understand where and how to spot hallucinations and requiring them to verify AI generated output prior to acting on it.\nOther safety protocols to consider include real time toxic input filters and strict system prompt guardrails, Palanichamy advised. Also, methods such as continuous risk tiering can help categorize AI use cases by the level of risk they pose to the organization.\nFor example, a client-facing medical or financial analysis bot may require daily auditing and specific restrictions to ensure it does not infringe on sensitive information, “whereas an internal AI tool to help with summarizing public meeting transcripts may not need as much governance oversight,” he said.","confidence":0.9,"diagnostics_url":"/api/diagnose?url=https%3A//www.cio.com/article/4226392/the-companies-racing-to-build-frontier-ai-are-now-racing-to-govern-it.html","quality_bucket":"high","failure_kind":"none","retryable":false,"quality_reason":"High confidence: full text extraction produced 6291 characters.","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 6291 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":6291,"summary_length":333,"usable_text_length":6291,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":6291,"summary_length":333}},"tags":[],"format_contract_version":"news_item_formats.v1"}}}