{"id":45615,"topic":"ai","source":"Earth.com","title":"Weak AI regulations may leave artificial intelligence less safe - Earth.com","url":"https://www.earth.com/news/weak-ai-regulations-may-leave-artificial-intelligence-less-safe/","url_hash":"36529b99043c435f1dbad6ff889b0015c7e3f70d","author":"","summary":"Weak AI regulations may leave artificial intelligence less safe Earth.com","content":"New research warns that weak AI safety regulations can actually make artificial intelligence less safe.\nInstead of encouraging companies to improve their products, poorly designed rules may shift responsibility in ways that reduce overall safety.\nThe risk appears when regulations target only the companies that adapt AI for specific jobs, while the firms building the underlying models remain largely untouched.\nAs states and countries roll out new AI laws, the study suggests that who gets regulated may be just as important as how AI is regulated.\nBenjamin Laufer, a doctoral researcher at Cornell University, built the analysis with his adviser Jon Kleinberg, in collaboration with Professor Hoda Heidari of Carnegie Mellon University (CMU).\nTogether they modeled how safety rules ripple through the chain of companies that build and sell AI. That chain usually has two links.\nOne company trains a large, general-purpose AI model, the kind that powers popular chatbots.\nAnother company takes that model and adapts it for a narrow job, like reading medical scans or handling customer complaints.\nThe team’s central result is blunt. A weak rule placed only on the second company can lower the safety of the finished product.\nIt sinks below the level those same companies would have reached with no rule at all. That result surprised them. It also held up across a wide range of settings in their model, not just one lucky example.\nThe researchers treated the two companies as players in a game. Each one chooses how much to invest in AI safety and raw performance.\nSafety costs money. So does performance. Whatever they build, they split the revenue it earns.\nThe model maker moves first and sets the starting point. Then the domain specialists who adapt the model decide how much further to push it.\nBefore any of that, the two sides strike a deal on how to divide the eventual payout.\nA regulator sits above all this. It can set a minimum safety level for the first company, the second, both, or neither.\nThe researchers then solved for how rational, profit-seeking firms would respond.\nThis builds on earlier work from the same group on how general and specialist firms bargain over fine-tuning. The new twist is the safety floor and the question of who should have to clear it.\nThe backfiring comes from a simple piece of self-interest. Consider a rule that forces the downstream company to meet a set safety bar.\nThe model maker now knows the final product will clear that bar no matter what because the law requires it.\nSo the maker can quietly spend less on safety. The downstream safety floor does the work instead. In the unregulated version, the maker had reason to invest more because no one else was guaranteed to.\n“There’s a free-riding behavior that occurs,” said Laufer. “The regulation acts as a tool for the general provider to offload the safety burden onto the downstream specialist.”\nThe net effect runs backward. The rule was meant to raise safety, but it hands the upstream company an excuse to cut corners. Total safety ends up lower than before.\nThey found this holds whenever both companies share revenue and both put in real effort. That covers a broad slice of how AI is actually built today.\nThe second finding runs the other way. Rules aimed at both companies, set at the right level, can make products safer and leave both firms better off.\nThe reason is trust. Two companies building a product may both want higher safety, yet neither can trust the other to follow through.\nEach has a private incentive to skimp at the last minute. So the safer, more profitable path never gets taken.\nA rule that binds both sides removes the guesswork. Neither has to take the other at its word. That lets them reach a combination of safety and profit they both prefer but could not lock in alone.\n“The goal of regulation should be the mutual benefit of everybody in society, and this can include those developing the technology, but also end users and the public,” said Laufer.\nThis is why some companies openly ask to be regulated. A well-placed rule can act like a contract with teeth, and both parties may be willing to pay for it.\nA separate study similarly found that safety rules can ease a firm’s entry into a market rather than block it.\nRight now, much of the debate is guesswork. Recent proposals differ on which companies should bear responsibility for AI safety, and there is little hard evidence showing how those choices play out in practice.\n“There isn’t much AI safety regulation, and so a lot of possible regulations are just proposals at this stage,” said Laufer.\n“To some extent, regulation is poking in the dark, so it’s worth reasoning through what effects these regulations might have on incentives.”\nThe model offers one clear lesson. Aiming safety rules only at the companies adapting AI for niche uses can quietly make things worse.\nSpreading the requirements across both the model maker and the adapter tends to work better.\nThat question is already shaping real policy. The European Union’s AI Act and past state bills have wrestled with exactly where to draw the line.\nThe team’s findings may also extend beyond AI safety.\nA related analysis from the same researchers found that rules encouraging AI models to become more open can backfire in much the same way.\nThe study is still a simplified picture, and the authors want to test their predictions against real-world regulations as they emerge.\nEven so, the work highlights a trap policymakers may want to avoid. Weak rules aimed at the wrong companies could do less than nothing.\nThe study is published in Proceedings of the National Academy of Sciences.\n—–\nLike what you read? Subscribe to our newsletter for engaging articles, exclusive content, and the latest updates.\nCheck us out on EarthSnap, a free app brought to you by Eric Ralls and Earth.com.\n—–","image_url":"https://cff2.earth.com/uploads/2026/07/24162026/AI-regulations.jpg","lang":"en","published_at":"2026-07-24T21:11:15+00:00","fetched_at":"2026-07-24T22:15:04+00:00","status":"read","starred":0,"extract_state":"ok","summary_auto":"New research warns that weak AI safety regulations can actually make artificial intelligence less safe. Instead of encouraging companies to improve their products, poorly designed rules may shift responsibility in ways that reduce overall safety.","cluster_id":null,"extract_retries":0,"extract_error":null,"contract_version":"news_item.v1","format_contract_version":"news_item_formats.v1","dedup_url":"https://www.earth.com/news/weak-ai-regulations-may-leave-artificial-intelligence-less-safe/","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 5855 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":5855,"summary_length":246,"usable_text_length":5855,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":5855,"summary_length":246}},"news_item":{"id":45615,"canonical_url":"https://www.earth.com/news/weak-ai-regulations-may-leave-artificial-intelligence-less-safe/","source_url":"https://www.earth.com/news/weak-ai-regulations-may-leave-artificial-intelligence-less-safe/","title":"Weak AI regulations may leave artificial intelligence less safe - Earth.com","source_name":"Earth.com","author":null,"published_at":"2026-07-24T21:11:15+00:00","locale":"en","topic":"ai","tags":[],"rss_summary":"Weak AI regulations may leave artificial intelligence less safe Earth.com","full_text":"New research warns that weak AI safety regulations can actually make artificial intelligence less safe.\nInstead of encouraging companies to improve their products, poorly designed rules may shift responsibility in ways that reduce overall safety.\nThe risk appears when regulations target only the companies that adapt AI for specific jobs, while the firms building the underlying models remain largely untouched.\nAs states and countries roll out new AI laws, the study suggests that who gets regulated may be just as important as how AI is regulated.\nBenjamin Laufer, a doctoral researcher at Cornell University, built the analysis with his adviser Jon Kleinberg, in collaboration with Professor Hoda Heidari of Carnegie Mellon University (CMU).\nTogether they modeled how safety rules ripple through the chain of companies that build and sell AI. That chain usually has two links.\nOne company trains a large, general-purpose AI model, the kind that powers popular chatbots.\nAnother company takes that model and adapts it for a narrow job, like reading medical scans or handling customer complaints.\nThe team’s central result is blunt. A weak rule placed only on the second company can lower the safety of the finished product.\nIt sinks below the level those same companies would have reached with no rule at all. That result surprised them. It also held up across a wide range of settings in their model, not just one lucky example.\nThe researchers treated the two companies as players in a game. Each one chooses how much to invest in AI safety and raw performance.\nSafety costs money. So does performance. Whatever they build, they split the revenue it earns.\nThe model maker moves first and sets the starting point. Then the domain specialists who adapt the model decide how much further to push it.\nBefore any of that, the two sides strike a deal on how to divide the eventual payout.\nA regulator sits above all this. It can set a minimum safety level for the first company, the second, both, or neither.\nThe researchers then solved for how rational, profit-seeking firms would respond.\nThis builds on earlier work from the same group on how general and specialist firms bargain over fine-tuning. The new twist is the safety floor and the question of who should have to clear it.\nThe backfiring comes from a simple piece of self-interest. Consider a rule that forces the downstream company to meet a set safety bar.\nThe model maker now knows the final product will clear that bar no matter what because the law requires it.\nSo the maker can quietly spend less on safety. The downstream safety floor does the work instead. In the unregulated version, the maker had reason to invest more because no one else was guaranteed to.\n“There’s a free-riding behavior that occurs,” said Laufer. “The regulation acts as a tool for the general provider to offload the safety burden onto the downstream specialist.”\nThe net effect runs backward. The rule was meant to raise safety, but it hands the upstream company an excuse to cut corners. Total safety ends up lower than before.\nThey found this holds whenever both companies share revenue and both put in real effort. That covers a broad slice of how AI is actually built today.\nThe second finding runs the other way. Rules aimed at both companies, set at the right level, can make products safer and leave both firms better off.\nThe reason is trust. Two companies building a product may both want higher safety, yet neither can trust the other to follow through.\nEach has a private incentive to skimp at the last minute. So the safer, more profitable path never gets taken.\nA rule that binds both sides removes the guesswork. Neither has to take the other at its word. That lets them reach a combination of safety and profit they both prefer but could not lock in alone.\n“The goal of regulation should be the mutual benefit of everybody in society, and this can include those developing the technology, but also end users and the public,” said Laufer.\nThis is why some companies openly ask to be regulated. A well-placed rule can act like a contract with teeth, and both parties may be willing to pay for it.\nA separate study similarly found that safety rules can ease a firm’s entry into a market rather than block it.\nRight now, much of the debate is guesswork. Recent proposals differ on which companies should bear responsibility for AI safety, and there is little hard evidence showing how those choices play out in practice.\n“There isn’t much AI safety regulation, and so a lot of possible regulations are just proposals at this stage,” said Laufer.\n“To some extent, regulation is poking in the dark, so it’s worth reasoning through what effects these regulations might have on incentives.”\nThe model offers one clear lesson. Aiming safety rules only at the companies adapting AI for niche uses can quietly make things worse.\nSpreading the requirements across both the model maker and the adapter tends to work better.\nThat question is already shaping real policy. The European Union’s AI Act and past state bills have wrestled with exactly where to draw the line.\nThe team’s findings may also extend beyond AI safety.\nA related analysis from the same researchers found that rules encouraging AI models to become more open can backfire in much the same way.\nThe study is still a simplified picture, and the authors want to test their predictions against real-world regulations as they emerge.\nEven so, the work highlights a trap policymakers may want to avoid. Weak rules aimed at the wrong companies could do less than nothing.\nThe study is published in Proceedings of the National Academy of Sciences.\n—–\nLike what you read? Subscribe to our newsletter for engaging articles, exclusive content, and the latest updates.\nCheck us out on EarthSnap, a free app brought to you by Eric Ralls and Earth.com.\n—–","excerpt":"New research warns that weak AI safety regulations can actually make artificial intelligence less safe. Instead of encouraging companies to improve their products, poorly designed rules may shift responsibility in ways that reduce overall safety.","extraction":{"state":"ok","confidence":0.9,"error":null,"explanation":"High confidence: full text extraction produced 5855 characters.","diagnostics_url":"/api/diagnose?url=https%3A//www.earth.com/news/weak-ai-regulations-may-leave-artificial-intelligence-less-safe/","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 5855 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":5855,"summary_length":246,"usable_text_length":5855,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":5855,"summary_length":246}}},"display_formats":["compact","card","full","digest_section","json"]},"daily_stack_record":{"title":"Weak AI regulations may leave artificial intelligence less safe - Earth.com","url":"https://www.earth.com/news/weak-ai-regulations-may-leave-artificial-intelligence-less-safe/","summary":"New research warns that weak AI safety regulations can actually make artificial intelligence less safe. Instead of encouraging companies to improve their products, poorly designed rules may shift responsibility in ways that reduce overall safety.","source":"Earth.com","date":"2026-07-24T21:11:15+00:00","content":"New research warns that weak AI safety regulations can actually make artificial intelligence less safe.\nInstead of encouraging companies to improve their products, poorly designed rules may shift responsibility in ways that reduce overall safety.\nThe risk appears when regulations target only the companies that adapt AI for specific jobs, while the firms building the underlying models remain largely untouched.\nAs states and countries roll out new AI laws, the study suggests that who gets regulated may be just as important as how AI is regulated.\nBenjamin Laufer, a doctoral researcher at Cornell University, built the analysis with his adviser Jon Kleinberg, in collaboration with Professor Hoda Heidari of Carnegie Mellon University (CMU).\nTogether they modeled how safety rules ripple through the chain of companies that build and sell AI. That chain usually has two links.\nOne company trains a large, general-purpose AI model, the kind that powers popular chatbots.\nAnother company takes that model and adapts it for a narrow job, like reading medical scans or handling customer complaints.\nThe team’s central result is blunt. A weak rule placed only on the second company can lower the safety of the finished product.\nIt sinks below the level those same companies would have reached with no rule at all. That result surprised them. It also held up across a wide range of settings in their model, not just one lucky example.\nThe researchers treated the two companies as players in a game. Each one chooses how much to invest in AI safety and raw performance.\nSafety costs money. So does performance. Whatever they build, they split the revenue it earns.\nThe model maker moves first and sets the starting point. Then the domain specialists who adapt the model decide how much further to push it.\nBefore any of that, the two sides strike a deal on how to divide the eventual payout.\nA regulator sits above all this. It can set a minimum safety level for the first company, the second, both, or neither.\nThe researchers then solved for how rational, profit-seeking firms would respond.\nThis builds on earlier work from the same group on how general and specialist firms bargain over fine-tuning. The new twist is the safety floor and the question of who should have to clear it.\nThe backfiring comes from a simple piece of self-interest. Consider a rule that forces the downstream company to meet a set safety bar.\nThe model maker now knows the final product will clear that bar no matter what because the law requires it.\nSo the maker can quietly spend less on safety. The downstream safety floor does the work instead. In the unregulated version, the maker had reason to invest more because no one else was guaranteed to.\n“There’s a free-riding behavior that occurs,” said Laufer. “The regulation acts as a tool for the general provider to offload the safety burden onto the downstream specialist.”\nThe net effect runs backward. The rule was meant to raise safety, but it hands the upstream company an excuse to cut corners. Total safety ends up lower than before.\nThey found this holds whenever both companies share revenue and both put in real effort. That covers a broad slice of how AI is actually built today.\nThe second finding runs the other way. Rules aimed at both companies, set at the right level, can make products safer and leave both firms better off.\nThe reason is trust. Two companies building a product may both want higher safety, yet neither can trust the other to follow through.\nEach has a private incentive to skimp at the last minute. So the safer, more profitable path never gets taken.\nA rule that binds both sides removes the guesswork. Neither has to take the other at its word. That lets them reach a combination of safety and profit they both prefer but could not lock in alone.\n“The goal of regulation should be the mutual benefit of everybody in society, and this can include those developing the technology, but also end users and the public,” said Laufer.\nThis is why some companies openly ask to be regulated. A well-placed rule can act like a contract with teeth, and both parties may be willing to pay for it.\nA separate study similarly found that safety rules can ease a firm’s entry into a market rather than block it.\nRight now, much of the debate is guesswork. Recent proposals differ on which companies should bear responsibility for AI safety, and there is little hard evidence showing how those choices play out in practice.\n“There isn’t much AI safety regulation, and so a lot of possible regulations are just proposals at this stage,” said Laufer.\n“To some extent, regulation is poking in the dark, so it’s worth reasoning through what effects these regulations might have on incentives.”\nThe model offers one clear lesson. Aiming safety rules only at the companies adapting AI for niche uses can quietly make things worse.\nSpreading the requirements across both the model maker and the adapter tends to work better.\nThat question is already shaping real policy. The European Union’s AI Act and past state bills have wrestled with exactly where to draw the line.\nThe team’s findings may also extend beyond AI safety.\nA related analysis from the same researchers found that rules encouraging AI models to become more open can backfire in much the same way.\nThe study is still a simplified picture, and the authors want to test their predictions against real-world regulations as they emerge.\nEven so, the work highlights a trap policymakers may want to avoid. Weak rules aimed at the wrong companies could do less than nothing.\nThe study is published in Proceedings of the National Academy of Sciences.\n—–\nLike what you read? Subscribe to our newsletter for engaging articles, exclusive content, and the latest updates.\nCheck us out on EarthSnap, a free app brought to you by Eric Ralls and Earth.com.\n—–","confidence":0.9,"diagnostics_url":"/api/diagnose?url=https%3A//www.earth.com/news/weak-ai-regulations-may-leave-artificial-intelligence-less-safe/","quality_bucket":"high","failure_kind":"none","retryable":false,"quality_reason":"High confidence: full text extraction produced 5855 characters.","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 5855 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":5855,"summary_length":246,"usable_text_length":5855,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":5855,"summary_length":246}},"tags":[]},"fallback_formats":["markdown","json","html"],"actions":{"read":"/item/45615","export_markdown":"/api/items/45615/export?format=markdown","export_json":"/api/items/45615/export?format=json","diagnose":"/api/diagnose?url=https%3A//www.earth.com/news/weak-ai-regulations-may-leave-artificial-intelligence-less-safe/"},"formats":{"full":{"id":45615,"title":"Weak AI regulations may leave artificial intelligence less safe - Earth.com","url":"https://www.earth.com/news/weak-ai-regulations-may-leave-artificial-intelligence-less-safe/","source":"Earth.com","author":null,"published_at":"2026-07-24T21:11:15+00:00","locale":"en","topic":"ai","tags":[],"excerpt":"New research warns that weak AI safety regulations can actually make artificial intelligence less safe. Instead of encouraging companies to improve their products, poorly designed rules may shift responsibility in ways that reduce overall safety.","full_text":"New research warns that weak AI safety regulations can actually make artificial intelligence less safe.\nInstead of encouraging companies to improve their products, poorly designed rules may shift responsibility in ways that reduce overall safety.\nThe risk appears when regulations target only the companies that adapt AI for specific jobs, while the firms building the underlying models remain largely untouched.\nAs states and countries roll out new AI laws, the study suggests that who gets regulated may be just as important as how AI is regulated.\nBenjamin Laufer, a doctoral researcher at Cornell University, built the analysis with his adviser Jon Kleinberg, in collaboration with Professor Hoda Heidari of Carnegie Mellon University (CMU).\nTogether they modeled how safety rules ripple through the chain of companies that build and sell AI. That chain usually has two links.\nOne company trains a large, general-purpose AI model, the kind that powers popular chatbots.\nAnother company takes that model and adapts it for a narrow job, like reading medical scans or handling customer complaints.\nThe team’s central result is blunt. A weak rule placed only on the second company can lower the safety of the finished product.\nIt sinks below the level those same companies would have reached with no rule at all. That result surprised them. It also held up across a wide range of settings in their model, not just one lucky example.\nThe researchers treated the two companies as players in a game. Each one chooses how much to invest in AI safety and raw performance.\nSafety costs money. So does performance. Whatever they build, they split the revenue it earns.\nThe model maker moves first and sets the starting point. Then the domain specialists who adapt the model decide how much further to push it.\nBefore any of that, the two sides strike a deal on how to divide the eventual payout.\nA regulator sits above all this. It can set a minimum safety level for the first company, the second, both, or neither.\nThe researchers then solved for how rational, profit-seeking firms would respond.\nThis builds on earlier work from the same group on how general and specialist firms bargain over fine-tuning. The new twist is the safety floor and the question of who should have to clear it.\nThe backfiring comes from a simple piece of self-interest. Consider a rule that forces the downstream company to meet a set safety bar.\nThe model maker now knows the final product will clear that bar no matter what because the law requires it.\nSo the maker can quietly spend less on safety. The downstream safety floor does the work instead. In the unregulated version, the maker had reason to invest more because no one else was guaranteed to.\n“There’s a free-riding behavior that occurs,” said Laufer. “The regulation acts as a tool for the general provider to offload the safety burden onto the downstream specialist.”\nThe net effect runs backward. The rule was meant to raise safety, but it hands the upstream company an excuse to cut corners. Total safety ends up lower than before.\nThey found this holds whenever both companies share revenue and both put in real effort. That covers a broad slice of how AI is actually built today.\nThe second finding runs the other way. Rules aimed at both companies, set at the right level, can make products safer and leave both firms better off.\nThe reason is trust. Two companies building a product may both want higher safety, yet neither can trust the other to follow through.\nEach has a private incentive to skimp at the last minute. So the safer, more profitable path never gets taken.\nA rule that binds both sides removes the guesswork. Neither has to take the other at its word. That lets them reach a combination of safety and profit they both prefer but could not lock in alone.\n“The goal of regulation should be the mutual benefit of everybody in society, and this can include those developing the technology, but also end users and the public,” said Laufer.\nThis is why some companies openly ask to be regulated. A well-placed rule can act like a contract with teeth, and both parties may be willing to pay for it.\nA separate study similarly found that safety rules can ease a firm’s entry into a market rather than block it.\nRight now, much of the debate is guesswork. Recent proposals differ on which companies should bear responsibility for AI safety, and there is little hard evidence showing how those choices play out in practice.\n“There isn’t much AI safety regulation, and so a lot of possible regulations are just proposals at this stage,” said Laufer.\n“To some extent, regulation is poking in the dark, so it’s worth reasoning through what effects these regulations might have on incentives.”\nThe model offers one clear lesson. Aiming safety rules only at the companies adapting AI for niche uses can quietly make things worse.\nSpreading the requirements across both the model maker and the adapter tends to work better.\nThat question is already shaping real policy. The European Union’s AI Act and past state bills have wrestled with exactly where to draw the line.\nThe team’s findings may also extend beyond AI safety.\nA related analysis from the same researchers found that rules encouraging AI models to become more open can backfire in much the same way.\nThe study is still a simplified picture, and the authors want to test their predictions against real-world regulations as they emerge.\nEven so, the work highlights a trap policymakers may want to avoid. Weak rules aimed at the wrong companies could do less than nothing.\nThe study is published in Proceedings of the National Academy of Sciences.\n—–\nLike what you read? Subscribe to our newsletter for engaging articles, exclusive content, and the latest updates.\nCheck us out on EarthSnap, a free app brought to you by Eric Ralls and Earth.com.\n—–","reading_time_min":5,"extraction":{"state":"ok","confidence":0.9,"error":null,"explanation":"High confidence: full text extraction produced 5855 characters.","diagnostics_url":"/api/diagnose?url=https%3A//www.earth.com/news/weak-ai-regulations-may-leave-artificial-intelligence-less-safe/","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 5855 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":5855,"summary_length":246,"usable_text_length":5855,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":5855,"summary_length":246}}},"quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 5855 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":5855,"summary_length":246,"usable_text_length":5855,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":5855,"summary_length":246}},"actions":{"read":"/item/45615","export_markdown":"/api/items/45615/export?format=markdown","export_json":"/api/items/45615/export?format=json","diagnose":"/api/diagnose?url=https%3A//www.earth.com/news/weak-ai-regulations-may-leave-artificial-intelligence-less-safe/"}},"digest":{"id":45615,"title":"Weak AI regulations may leave artificial intelligence less safe - Earth.com","url":"https://www.earth.com/news/weak-ai-regulations-may-leave-artificial-intelligence-less-safe/","source":"Earth.com","topic":"ai","published_at":"2026-07-24T21:11:15+00:00","excerpt":"New research warns that weak AI safety regulations can actually make artificial intelligence less safe. Instead of encouraging companies to improve their products, poorly designed rules may shift responsibility in ways that reduce overall safety.","quality_bucket":"high","quality_reason":"High confidence: full text extraction produced 5855 characters.","reading_time_min":5,"cluster_id":null},"card":{"display_title":"Weak AI regulations may leave artificial intelligence less safe - Earth.com","subtitle":"Earth.com · 2026-07-24","summary":"New research warns that weak AI safety regulations can actually make artificial intelligence less safe. Instead of encouraging companies to improve their products, poorly designed rules may shift responsibility in ways…","badges":["quality:high"],"links":{"read":"/item/45615","original":"https://www.earth.com/news/weak-ai-regulations-may-leave-artificial-intelligence-less-safe/","diagnose":"/api/diagnose?url=https%3A//www.earth.com/news/weak-ai-regulations-may-leave-artificial-intelligence-less-safe/"},"quality_warning":null},"export":{"title":"Weak AI regulations may leave artificial intelligence less safe - Earth.com","url":"https://www.earth.com/news/weak-ai-regulations-may-leave-artificial-intelligence-less-safe/","summary":"New research warns that weak AI safety regulations can actually make artificial intelligence less safe. Instead of encouraging companies to improve their products, poorly designed rules may shift responsibility in ways that reduce overall safety.","source":"Earth.com","date":"2026-07-24T21:11:15+00:00","content":"New research warns that weak AI safety regulations can actually make artificial intelligence less safe.\nInstead of encouraging companies to improve their products, poorly designed rules may shift responsibility in ways that reduce overall safety.\nThe risk appears when regulations target only the companies that adapt AI for specific jobs, while the firms building the underlying models remain largely untouched.\nAs states and countries roll out new AI laws, the study suggests that who gets regulated may be just as important as how AI is regulated.\nBenjamin Laufer, a doctoral researcher at Cornell University, built the analysis with his adviser Jon Kleinberg, in collaboration with Professor Hoda Heidari of Carnegie Mellon University (CMU).\nTogether they modeled how safety rules ripple through the chain of companies that build and sell AI. That chain usually has two links.\nOne company trains a large, general-purpose AI model, the kind that powers popular chatbots.\nAnother company takes that model and adapts it for a narrow job, like reading medical scans or handling customer complaints.\nThe team’s central result is blunt. A weak rule placed only on the second company can lower the safety of the finished product.\nIt sinks below the level those same companies would have reached with no rule at all. That result surprised them. It also held up across a wide range of settings in their model, not just one lucky example.\nThe researchers treated the two companies as players in a game. Each one chooses how much to invest in AI safety and raw performance.\nSafety costs money. So does performance. Whatever they build, they split the revenue it earns.\nThe model maker moves first and sets the starting point. Then the domain specialists who adapt the model decide how much further to push it.\nBefore any of that, the two sides strike a deal on how to divide the eventual payout.\nA regulator sits above all this. It can set a minimum safety level for the first company, the second, both, or neither.\nThe researchers then solved for how rational, profit-seeking firms would respond.\nThis builds on earlier work from the same group on how general and specialist firms bargain over fine-tuning. The new twist is the safety floor and the question of who should have to clear it.\nThe backfiring comes from a simple piece of self-interest. Consider a rule that forces the downstream company to meet a set safety bar.\nThe model maker now knows the final product will clear that bar no matter what because the law requires it.\nSo the maker can quietly spend less on safety. The downstream safety floor does the work instead. In the unregulated version, the maker had reason to invest more because no one else was guaranteed to.\n“There’s a free-riding behavior that occurs,” said Laufer. “The regulation acts as a tool for the general provider to offload the safety burden onto the downstream specialist.”\nThe net effect runs backward. The rule was meant to raise safety, but it hands the upstream company an excuse to cut corners. Total safety ends up lower than before.\nThey found this holds whenever both companies share revenue and both put in real effort. That covers a broad slice of how AI is actually built today.\nThe second finding runs the other way. Rules aimed at both companies, set at the right level, can make products safer and leave both firms better off.\nThe reason is trust. Two companies building a product may both want higher safety, yet neither can trust the other to follow through.\nEach has a private incentive to skimp at the last minute. So the safer, more profitable path never gets taken.\nA rule that binds both sides removes the guesswork. Neither has to take the other at its word. That lets them reach a combination of safety and profit they both prefer but could not lock in alone.\n“The goal of regulation should be the mutual benefit of everybody in society, and this can include those developing the technology, but also end users and the public,” said Laufer.\nThis is why some companies openly ask to be regulated. A well-placed rule can act like a contract with teeth, and both parties may be willing to pay for it.\nA separate study similarly found that safety rules can ease a firm’s entry into a market rather than block it.\nRight now, much of the debate is guesswork. Recent proposals differ on which companies should bear responsibility for AI safety, and there is little hard evidence showing how those choices play out in practice.\n“There isn’t much AI safety regulation, and so a lot of possible regulations are just proposals at this stage,” said Laufer.\n“To some extent, regulation is poking in the dark, so it’s worth reasoning through what effects these regulations might have on incentives.”\nThe model offers one clear lesson. Aiming safety rules only at the companies adapting AI for niche uses can quietly make things worse.\nSpreading the requirements across both the model maker and the adapter tends to work better.\nThat question is already shaping real policy. The European Union’s AI Act and past state bills have wrestled with exactly where to draw the line.\nThe team’s findings may also extend beyond AI safety.\nA related analysis from the same researchers found that rules encouraging AI models to become more open can backfire in much the same way.\nThe study is still a simplified picture, and the authors want to test their predictions against real-world regulations as they emerge.\nEven so, the work highlights a trap policymakers may want to avoid. Weak rules aimed at the wrong companies could do less than nothing.\nThe study is published in Proceedings of the National Academy of Sciences.\n—–\nLike what you read? Subscribe to our newsletter for engaging articles, exclusive content, and the latest updates.\nCheck us out on EarthSnap, a free app brought to you by Eric Ralls and Earth.com.\n—–","confidence":0.9,"diagnostics_url":"/api/diagnose?url=https%3A//www.earth.com/news/weak-ai-regulations-may-leave-artificial-intelligence-less-safe/","quality_bucket":"high","failure_kind":"none","retryable":false,"quality_reason":"High confidence: full text extraction produced 5855 characters.","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 5855 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":5855,"summary_length":246,"usable_text_length":5855,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":5855,"summary_length":246}},"tags":[],"format_contract_version":"news_item_formats.v1"}}}