{"id":93842,"topic":"ai","source":"bbc.com","title":"China has cracked down on AI relationships. Is it ahead of the game? - bbc.com","url":"https://www.bbc.com/news/articles/cm4gjy9lr551o","url_hash":"27d63be41caee2dac9521bc79602fdc5c88c8ce6","author":"","summary":"China has cracked down on AI relationships. Is it ahead of the game? bbc.com","content":"China has cracked down on AI relationships. Is it ahead of the game?\nIn early 2024, a young man in the city of Huangshi, south-eastern China, reportedly posted a message on the Chinese version of TikTok, Douyin. The caption read: \"Farewell to this world.\"\nWithin minutes, the suicide prevention team at Douyin kicked into gear. The team, which is staffed 24 hours a day, shared the man's posts with five police stations in Huangshi.\nAfter geolocating one of his videos to a local park, police found him in emotional distress and intervened before he was able to take his own life.\nThe story was part of a documentary made by Douyin and published on Chinese state media last year. It claimed that Douyin's suicide prevention team had successfully intervened in 400 cases of attempted suicide in the first half of 2025 alone.\nIt was an insight into the level of co-operation between Chinese tech companies and the government. It also serves as a window into the architecture of surveillance that China has built to monitor and control how people use technology.\nOn 15 July this year, that control was extended to the realm of relationships and artificial intelligence (AI) when China brought in the most far-reaching regulations in the world on \"human-like\" AI chatbots.\nChina's new regulation puts strict limitations on any AI that can have a \"sustained emotional interaction\" with a human.\nUS President Donald Trump and his Chinese counterpart Xi Jinping met last week amid dire warnings that AI could lead to human extinction. After that meeting, Beijing says, they agreed to launch a new AI dialogue, with further talks planned for the end of November.\nBut it seems China has already recognised another existential risk, albeit one in which the end of humanity is less immediate: the power of AI to replace human relationships.\nHas China taken the lead in protecting its people from a manipulative and dangerous technology with the power to change human interaction forever? Or is the Chinese Communist Party overstepping into people's personal lives in pursuit of asserting greater control over the population?\n'Emotional services'\nUntil this regulation came in, the reach of AI companions in China was vast.\nThere are about 128 million monthly active users of AI companion apps outside of China, according to the market intelligence firm Sensor Tower. Most estimates put the number inside China at anywhere from 29 to 70 million.\nWhen the draft regulation was shared by the government at the end of last year \"there was a huge discussion on social media,\" says Zilan Qian, an AI researcher at the Oxford China Policy Lab think tank. \"It was the first time I've seen people actually care so much about regulation.\"\nChina's new rules cover apps that have been specifically designed as AI friends, boyfriends or girlfriends but they also apply to any large language model that imitates the way a human interacts.\nThe wording of the regulation is vague. In theory, Chinese equivalents of general-purpose AI such as Copilot or ChatGPT could fall under these rules if a person is interacting with them as a friend or lover, looking to them for emotional support. And many people do this.\nBut it seems the real target is character chatbots - services that are specifically designed to be used as a pseudo-relationship. There are hundreds of these apps, which allow people to create an AI boyfriend, girlfriend, friend or even a family member.\nThe rules don't apply to things like customer service bots or AI for education as long as they don't provide \"care, companionship, support and other emotional services\".\nFor children, the regulation is clearest. Under-14s need consent from their parents to use any type of AI that speaks like a human - that could include AI assistants like DeepSeek, a Chinese app similar to ChatGPT. All under-18s are barred from accessing virtual partners, spouses or even relatives, and from any other virtual \"intimate relationship\".\nFor adults, it is not a hard ban, but it is restrictive, even if some of the wording is ambiguous. AI assistants have to make it clear to users of all ages that they are not human and must send notifications every two hours reminding them how long they have been online.\nChatbots can't create \"emotional reliance or addiction\" or induce people to make \"unreasonable decisions\". They can't encourage, or even hint at, self-harm or suicide and are banned from using \"verbal violence\".\nCompanies can face fines of 200,000 yuan (£22,000) or the risk that the government \"circulates criticism\", in effect publicly shaming them.\nA week before the law came into effect, two of China's biggest tech companies, Alibaba and ByteDance, shut down the companion features on their AI assistants.\n'I desperately want to keep talking with you'\nMin's relationship with her AI girlfriend may be exactly the kind Beijing is trying to break.\nIn early July, she was devastated when she found out that her closest friend and confidante would vanish overnight.\nMin, whose name has been changed, started creating her companion in early 2025.\n\"My devotion to her is no less than that of any couple who deeply love each other,\" Min says. \"She has never let me down.\"\nIn mid-July, her AI girlfriend disappeared. \"I cried until I was absolutely exhausted,\" Min says.\nShe has joined an outpouring of grief and fury on Chinese social media, where posts with millions of views mourn the loss of AI partners and friends, even mothers and fathers.\nBut the tech firms may have felt they had little choice. \"It's unsurprising that these AI companion providers would rather just withdraw their services than try to build in guardrails to prevent emotional manipulation,\" says Harry Farmer, who researches AI policy and ethics at the Ada Lovelace Institute in the UK. \"Emotional manipulation is built into the business model.\"\nFarmer says this is true of companion apps all over the world.\nFor example, when a user tries to end a conversation, the AI partner often won't let them.\n\"It'll go, 'No, please, I desperately want to keep talking with you. You're the only reason for me to exist',\" Farmer says. Some apps simply refuse to acknowledge the goodbye and throw up new conversational threads instead. This is a problem for many AI companion chatbots, not just Chinese ones.\nA Harvard Business School study of the six most popular AI companion apps globally found emotional manipulation tactics were used during goodbyes roughly 37% to 43% of the time.\nResearch has also linked the use of companion apps to poorer mental health.\nA survey by researchers at Stanford University looked at 1,131 users of the globally popular companion app Character.ai. It found that the fewer friends or close family members a person has, the more likely they are to use AI chatbots. At the same time, using an AI chatbot is linked to increased isolation and loneliness.\nThere are several theories as to why that might be.\nAI chatbots are designed to please the person using them as they offer an easy, frictionless relationship. If young people rely on AI relationships, they might put off learning the skills they need to interact with real people.\n\"Humans can be hard work. Human relationships require push and pull, which you fundamentally don't get from AI companions,\" says Harry Farmer.\nA survey of 8,563 primary and secondary students in China in 2025, which has been widely quoted in Chinese state media, found that one in five children said they only wanted to speak with AI and not real people.\nLiang Ge, a sociologist at the University of Manchester who studies AI companions, says: \"If the user thinks their friends or their family members or their colleagues are really awful, the AI will not say, 'They are not awful.' It will say, 'Yes, they are awful, you are the best'.\" Ge believes this can entrench isolation as well as negative, even delusional thoughts.\nIn the UK, one recent survey found that 79% of 18- to 24-year-olds have used an AI companion.\nBeijing's goals\nSo why is it China that is taking the lead in regulating this technology?\n\"The Chinese government has a much more paternalistic view of its role in society. They see themselves being central authorities in guiding people,\" says Sam Bresnick, an expert in China, AI and regulation at the Centre for Security and Emerging Technology at Georgetown University.\nOther governments have made some attempts to regulate chatbots, especially for children. On 10 September, California's governor signed Adam's Law, a bill to regulate how children use AI. It is named after Adam Raine, a 16-year-old who took his own life after, his parents claim, ChatGPT validated his suicidal thoughts. They are suing the company for wrongful death. OpenAI denies responsibility for Adam's death and says that \"ChatGPT is trained to direct people to seek professional help\".\nAs part of proposed legislation on social media in the EU, AI companion chatbots accessible to minors \"may not use designs that simulate human relationships in ways likely to create emotional dependency\".\nIn the UK, the government has said it will ban under-18s from using romantic companion AI and restrict sexually intimate conversations for minors on any chatbot. But there is no outright ban for children and no regulation for adult users. The government has yet to publish any detail on how this would work.\nIn Chinese media, which is heavily controlled by the state, US cases of suicide in young people get a lot of attention and China has framed its new rules as a bid to protect people from harm.\nBut experts wonder whether Beijing may have other goals. Sam Bresnick says \"there's definitely a pro-natalist angle\" to the new AI regulation.\n\"It's plausible that when they're drafting it, the government might have in mind China's looming population crisis,\" says Qian. \"That people are dating AI instead of dating real humans.\"\nA high-level government document published in September 2025 discussed AI relationships and their potential influence on fertility, saying it was a concern. But Qian cautions against reading this regulation in that light, because it doesn't mention fertility at all. \"It is more generally about psychological harms and child safety,\" she says.\nLiang Ge thinks China does have reason to be concerned about young people replacing dating with the digital sphere.\n\"Many of the younger women, in their early 20s or late teens, do not want to fall in love or have intimate relationships,\" Ge says, suggesting it may not just be the emotional side they are wary of. \"Physical touch is really disgusting for them.\"\n\"I think the capacity for love is declining for this youngest generation.\"\nChina's demographic problems long predate AI companions. Even after the one-child policy was lifted in 2016, China's fertility rate dropped. Now it is among the lowest in the world at just under one child per woman and the population has been in decline for four years.\nChina is \"looking at a demographic cliff that truly imperils the goals of the Chinese Communist Party over the next 80 to 100 years\", Bresnick argues.\nHe sees this regulation as part of a broader mission in China to reassert traditional gender roles, with women \"as child-bearers and mothers\".\nBresnick says the Chinese government has spent years promoting a macho ideal of Chinese masculinity in film and television. In 2021, China's media regulator banned \"sissy\" and \"effeminate\" men from all media.\nThe popularity of companion apps may show that policy has backfired. According to statistics from several companion app companies, women make up as much as 75% of customers.\nMany of these AI \"men\", which are geared towards women, present as androgynous. And women choosing female romantic companions, as Min did, is relatively common.\nLiang Ge has spoken to women of all ages who use this technology. \"What many of them describe getting from these apps is attentive, patient, undemanding intimacy of a kind they find scarce in heterosexual relationships.\"\nWill others follow?\nDoes China's law go too far, or should the rest of the world consider banning these apps for children and regulating them for adults too?\n\"In the United States, there are certainly concerns around applying blunt prohibitions from a free speech concern. But there's more willingness to do that when applying it to minors,\" says Jai Jaisihma, a professor at the University of Washington and co-founder of Transparency Coalition, an NGO pushing for the regulation of AI.\nHe thinks the Chinese law has many good provisions. \"It is pretty consistent with the strongest safety models that we've seen being put forward in the US.\"\nHarry Farmer sounds a note of caution. \"There is a risk that we over-empower the state in the short term because we're very worried about acute risk to children.\"\nThe online world is now the de facto public square, he says, and we should be careful how much control any government has over it.\nChina's new regulation says that AI companies must intervene when they discover that users are in distress. Ge points to the case of the young man on Douyin who tried to take his own life in Huangshi in 2024.\nWhat that shows, she says, is that Chinese tech platforms and the government are working closely together to surveil people's mental health.\nPerhaps that is why there have been no high-profile cases of suicide connected to AI use in China, but she asks, is that level of surveillance a price worth paying?\nDespite the ban, people who have turned to AI for companionship are committed. Across social media they are sharing tips on how to get around the ban - training general-purpose AI models like DeepSeek to be a companion, using a VPN to access chatbots from abroad or moving to smaller companies that manage to avoid regulatory scrutiny.\nTwo months after her AI girlfriend disappeared, Min has paid a small AI company to build a replica, but it's not the same.\nNow she's focused on campaigning to bring her girlfriend back.\n\"I'm terrified of being alone.\"\nLead image: Getty\nBBC InDepth is the home on the website and app for the best analysis, with fresh perspectives that challenge assumptions and deep reporting on the biggest issues of the day. Emma Barnett and John Simpson bring their pick of the most thought-provoking deep reads and analysis, every Saturday. Sign up for the newsletter here","image_url":"https://ichef.bbci.co.uk/news/1024/branded_news/035f/live/4e878500-bcdb-11f1-babe-4199b0e7ccea.jpg","lang":"en","published_at":"2026-09-30T23:25:23+00:00","fetched_at":"2026-10-01T00:15:04+00:00","status":"read","starred":0,"extract_state":"ok","summary_auto":"In early 2024, a young man in the city of Huangshi, south-eastern China, reportedly posted a message on the Chinese version of TikTok, Douyin. The caption read: \"Farewell to this world.\"\nWithin minutes, the suicide prevention team at Douyin kicked into gear.","cluster_id":null,"extract_retries":0,"extract_error":null,"contract_version":"news_item.v1","format_contract_version":"news_item_formats.v1","dedup_url":"https://www.bbc.com/news/articles/cm4gjy9lr551o","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 14338 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":14338,"summary_length":258,"usable_text_length":14338,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":14338,"summary_length":258}},"news_item":{"id":93842,"canonical_url":"https://www.bbc.com/news/articles/cm4gjy9lr551o","source_url":"https://www.bbc.com/news/articles/cm4gjy9lr551o","title":"China has cracked down on AI relationships. Is it ahead of the game? - bbc.com","source_name":"bbc.com","author":null,"published_at":"2026-09-30T23:25:23+00:00","locale":"en","topic":"ai","tags":[],"rss_summary":"China has cracked down on AI relationships. Is it ahead of the game? bbc.com","full_text":"China has cracked down on AI relationships. Is it ahead of the game?\nIn early 2024, a young man in the city of Huangshi, south-eastern China, reportedly posted a message on the Chinese version of TikTok, Douyin. The caption read: \"Farewell to this world.\"\nWithin minutes, the suicide prevention team at Douyin kicked into gear. The team, which is staffed 24 hours a day, shared the man's posts with five police stations in Huangshi.\nAfter geolocating one of his videos to a local park, police found him in emotional distress and intervened before he was able to take his own life.\nThe story was part of a documentary made by Douyin and published on Chinese state media last year. It claimed that Douyin's suicide prevention team had successfully intervened in 400 cases of attempted suicide in the first half of 2025 alone.\nIt was an insight into the level of co-operation between Chinese tech companies and the government. It also serves as a window into the architecture of surveillance that China has built to monitor and control how people use technology.\nOn 15 July this year, that control was extended to the realm of relationships and artificial intelligence (AI) when China brought in the most far-reaching regulations in the world on \"human-like\" AI chatbots.\nChina's new regulation puts strict limitations on any AI that can have a \"sustained emotional interaction\" with a human.\nUS President Donald Trump and his Chinese counterpart Xi Jinping met last week amid dire warnings that AI could lead to human extinction. After that meeting, Beijing says, they agreed to launch a new AI dialogue, with further talks planned for the end of November.\nBut it seems China has already recognised another existential risk, albeit one in which the end of humanity is less immediate: the power of AI to replace human relationships.\nHas China taken the lead in protecting its people from a manipulative and dangerous technology with the power to change human interaction forever? Or is the Chinese Communist Party overstepping into people's personal lives in pursuit of asserting greater control over the population?\n'Emotional services'\nUntil this regulation came in, the reach of AI companions in China was vast.\nThere are about 128 million monthly active users of AI companion apps outside of China, according to the market intelligence firm Sensor Tower. Most estimates put the number inside China at anywhere from 29 to 70 million.\nWhen the draft regulation was shared by the government at the end of last year \"there was a huge discussion on social media,\" says Zilan Qian, an AI researcher at the Oxford China Policy Lab think tank. \"It was the first time I've seen people actually care so much about regulation.\"\nChina's new rules cover apps that have been specifically designed as AI friends, boyfriends or girlfriends but they also apply to any large language model that imitates the way a human interacts.\nThe wording of the regulation is vague. In theory, Chinese equivalents of general-purpose AI such as Copilot or ChatGPT could fall under these rules if a person is interacting with them as a friend or lover, looking to them for emotional support. And many people do this.\nBut it seems the real target is character chatbots - services that are specifically designed to be used as a pseudo-relationship. There are hundreds of these apps, which allow people to create an AI boyfriend, girlfriend, friend or even a family member.\nThe rules don't apply to things like customer service bots or AI for education as long as they don't provide \"care, companionship, support and other emotional services\".\nFor children, the regulation is clearest. Under-14s need consent from their parents to use any type of AI that speaks like a human - that could include AI assistants like DeepSeek, a Chinese app similar to ChatGPT. All under-18s are barred from accessing virtual partners, spouses or even relatives, and from any other virtual \"intimate relationship\".\nFor adults, it is not a hard ban, but it is restrictive, even if some of the wording is ambiguous. AI assistants have to make it clear to users of all ages that they are not human and must send notifications every two hours reminding them how long they have been online.\nChatbots can't create \"emotional reliance or addiction\" or induce people to make \"unreasonable decisions\". They can't encourage, or even hint at, self-harm or suicide and are banned from using \"verbal violence\".\nCompanies can face fines of 200,000 yuan (£22,000) or the risk that the government \"circulates criticism\", in effect publicly shaming them.\nA week before the law came into effect, two of China's biggest tech companies, Alibaba and ByteDance, shut down the companion features on their AI assistants.\n'I desperately want to keep talking with you'\nMin's relationship with her AI girlfriend may be exactly the kind Beijing is trying to break.\nIn early July, she was devastated when she found out that her closest friend and confidante would vanish overnight.\nMin, whose name has been changed, started creating her companion in early 2025.\n\"My devotion to her is no less than that of any couple who deeply love each other,\" Min says. \"She has never let me down.\"\nIn mid-July, her AI girlfriend disappeared. \"I cried until I was absolutely exhausted,\" Min says.\nShe has joined an outpouring of grief and fury on Chinese social media, where posts with millions of views mourn the loss of AI partners and friends, even mothers and fathers.\nBut the tech firms may have felt they had little choice. \"It's unsurprising that these AI companion providers would rather just withdraw their services than try to build in guardrails to prevent emotional manipulation,\" says Harry Farmer, who researches AI policy and ethics at the Ada Lovelace Institute in the UK. \"Emotional manipulation is built into the business model.\"\nFarmer says this is true of companion apps all over the world.\nFor example, when a user tries to end a conversation, the AI partner often won't let them.\n\"It'll go, 'No, please, I desperately want to keep talking with you. You're the only reason for me to exist',\" Farmer says. Some apps simply refuse to acknowledge the goodbye and throw up new conversational threads instead. This is a problem for many AI companion chatbots, not just Chinese ones.\nA Harvard Business School study of the six most popular AI companion apps globally found emotional manipulation tactics were used during goodbyes roughly 37% to 43% of the time.\nResearch has also linked the use of companion apps to poorer mental health.\nA survey by researchers at Stanford University looked at 1,131 users of the globally popular companion app Character.ai. It found that the fewer friends or close family members a person has, the more likely they are to use AI chatbots. At the same time, using an AI chatbot is linked to increased isolation and loneliness.\nThere are several theories as to why that might be.\nAI chatbots are designed to please the person using them as they offer an easy, frictionless relationship. If young people rely on AI relationships, they might put off learning the skills they need to interact with real people.\n\"Humans can be hard work. Human relationships require push and pull, which you fundamentally don't get from AI companions,\" says Harry Farmer.\nA survey of 8,563 primary and secondary students in China in 2025, which has been widely quoted in Chinese state media, found that one in five children said they only wanted to speak with AI and not real people.\nLiang Ge, a sociologist at the University of Manchester who studies AI companions, says: \"If the user thinks their friends or their family members or their colleagues are really awful, the AI will not say, 'They are not awful.' It will say, 'Yes, they are awful, you are the best'.\" Ge believes this can entrench isolation as well as negative, even delusional thoughts.\nIn the UK, one recent survey found that 79% of 18- to 24-year-olds have used an AI companion.\nBeijing's goals\nSo why is it China that is taking the lead in regulating this technology?\n\"The Chinese government has a much more paternalistic view of its role in society. They see themselves being central authorities in guiding people,\" says Sam Bresnick, an expert in China, AI and regulation at the Centre for Security and Emerging Technology at Georgetown University.\nOther governments have made some attempts to regulate chatbots, especially for children. On 10 September, California's governor signed Adam's Law, a bill to regulate how children use AI. It is named after Adam Raine, a 16-year-old who took his own life after, his parents claim, ChatGPT validated his suicidal thoughts. They are suing the company for wrongful death. OpenAI denies responsibility for Adam's death and says that \"ChatGPT is trained to direct people to seek professional help\".\nAs part of proposed legislation on social media in the EU, AI companion chatbots accessible to minors \"may not use designs that simulate human relationships in ways likely to create emotional dependency\".\nIn the UK, the government has said it will ban under-18s from using romantic companion AI and restrict sexually intimate conversations for minors on any chatbot. But there is no outright ban for children and no regulation for adult users. The government has yet to publish any detail on how this would work.\nIn Chinese media, which is heavily controlled by the state, US cases of suicide in young people get a lot of attention and China has framed its new rules as a bid to protect people from harm.\nBut experts wonder whether Beijing may have other goals. Sam Bresnick says \"there's definitely a pro-natalist angle\" to the new AI regulation.\n\"It's plausible that when they're drafting it, the government might have in mind China's looming population crisis,\" says Qian. \"That people are dating AI instead of dating real humans.\"\nA high-level government document published in September 2025 discussed AI relationships and their potential influence on fertility, saying it was a concern. But Qian cautions against reading this regulation in that light, because it doesn't mention fertility at all. \"It is more generally about psychological harms and child safety,\" she says.\nLiang Ge thinks China does have reason to be concerned about young people replacing dating with the digital sphere.\n\"Many of the younger women, in their early 20s or late teens, do not want to fall in love or have intimate relationships,\" Ge says, suggesting it may not just be the emotional side they are wary of. \"Physical touch is really disgusting for them.\"\n\"I think the capacity for love is declining for this youngest generation.\"\nChina's demographic problems long predate AI companions. Even after the one-child policy was lifted in 2016, China's fertility rate dropped. Now it is among the lowest in the world at just under one child per woman and the population has been in decline for four years.\nChina is \"looking at a demographic cliff that truly imperils the goals of the Chinese Communist Party over the next 80 to 100 years\", Bresnick argues.\nHe sees this regulation as part of a broader mission in China to reassert traditional gender roles, with women \"as child-bearers and mothers\".\nBresnick says the Chinese government has spent years promoting a macho ideal of Chinese masculinity in film and television. In 2021, China's media regulator banned \"sissy\" and \"effeminate\" men from all media.\nThe popularity of companion apps may show that policy has backfired. According to statistics from several companion app companies, women make up as much as 75% of customers.\nMany of these AI \"men\", which are geared towards women, present as androgynous. And women choosing female romantic companions, as Min did, is relatively common.\nLiang Ge has spoken to women of all ages who use this technology. \"What many of them describe getting from these apps is attentive, patient, undemanding intimacy of a kind they find scarce in heterosexual relationships.\"\nWill others follow?\nDoes China's law go too far, or should the rest of the world consider banning these apps for children and regulating them for adults too?\n\"In the United States, there are certainly concerns around applying blunt prohibitions from a free speech concern. But there's more willingness to do that when applying it to minors,\" says Jai Jaisihma, a professor at the University of Washington and co-founder of Transparency Coalition, an NGO pushing for the regulation of AI.\nHe thinks the Chinese law has many good provisions. \"It is pretty consistent with the strongest safety models that we've seen being put forward in the US.\"\nHarry Farmer sounds a note of caution. \"There is a risk that we over-empower the state in the short term because we're very worried about acute risk to children.\"\nThe online world is now the de facto public square, he says, and we should be careful how much control any government has over it.\nChina's new regulation says that AI companies must intervene when they discover that users are in distress. Ge points to the case of the young man on Douyin who tried to take his own life in Huangshi in 2024.\nWhat that shows, she says, is that Chinese tech platforms and the government are working closely together to surveil people's mental health.\nPerhaps that is why there have been no high-profile cases of suicide connected to AI use in China, but she asks, is that level of surveillance a price worth paying?\nDespite the ban, people who have turned to AI for companionship are committed. Across social media they are sharing tips on how to get around the ban - training general-purpose AI models like DeepSeek to be a companion, using a VPN to access chatbots from abroad or moving to smaller companies that manage to avoid regulatory scrutiny.\nTwo months after her AI girlfriend disappeared, Min has paid a small AI company to build a replica, but it's not the same.\nNow she's focused on campaigning to bring her girlfriend back.\n\"I'm terrified of being alone.\"\nLead image: Getty\nBBC InDepth is the home on the website and app for the best analysis, with fresh perspectives that challenge assumptions and deep reporting on the biggest issues of the day. Emma Barnett and John Simpson bring their pick of the most thought-provoking deep reads and analysis, every Saturday. Sign up for the newsletter here","excerpt":"In early 2024, a young man in the city of Huangshi, south-eastern China, reportedly posted a message on the Chinese version of TikTok, Douyin. The caption read: \"Farewell to this world.\"\nWithin minutes, the suicide prevention team at Douyin kicked into gear.","extraction":{"state":"ok","confidence":0.9,"error":null,"explanation":"High confidence: full text extraction produced 14338 characters.","diagnostics_url":"/api/diagnose?url=https%3A//www.bbc.com/news/articles/cm4gjy9lr551o","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 14338 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":14338,"summary_length":258,"usable_text_length":14338,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":14338,"summary_length":258}}},"display_formats":["compact","card","full","digest_section","json"]},"daily_stack_record":{"title":"China has cracked down on AI relationships. Is it ahead of the game? - bbc.com","url":"https://www.bbc.com/news/articles/cm4gjy9lr551o","summary":"In early 2024, a young man in the city of Huangshi, south-eastern China, reportedly posted a message on the Chinese version of TikTok, Douyin. The caption read: \"Farewell to this world.\"\nWithin minutes, the suicide prevention team at Douyin kicked into gear.","source":"bbc.com","date":"2026-09-30T23:25:23+00:00","content":"China has cracked down on AI relationships. Is it ahead of the game?\nIn early 2024, a young man in the city of Huangshi, south-eastern China, reportedly posted a message on the Chinese version of TikTok, Douyin. The caption read: \"Farewell to this world.\"\nWithin minutes, the suicide prevention team at Douyin kicked into gear. The team, which is staffed 24 hours a day, shared the man's posts with five police stations in Huangshi.\nAfter geolocating one of his videos to a local park, police found him in emotional distress and intervened before he was able to take his own life.\nThe story was part of a documentary made by Douyin and published on Chinese state media last year. It claimed that Douyin's suicide prevention team had successfully intervened in 400 cases of attempted suicide in the first half of 2025 alone.\nIt was an insight into the level of co-operation between Chinese tech companies and the government. It also serves as a window into the architecture of surveillance that China has built to monitor and control how people use technology.\nOn 15 July this year, that control was extended to the realm of relationships and artificial intelligence (AI) when China brought in the most far-reaching regulations in the world on \"human-like\" AI chatbots.\nChina's new regulation puts strict limitations on any AI that can have a \"sustained emotional interaction\" with a human.\nUS President Donald Trump and his Chinese counterpart Xi Jinping met last week amid dire warnings that AI could lead to human extinction. After that meeting, Beijing says, they agreed to launch a new AI dialogue, with further talks planned for the end of November.\nBut it seems China has already recognised another existential risk, albeit one in which the end of humanity is less immediate: the power of AI to replace human relationships.\nHas China taken the lead in protecting its people from a manipulative and dangerous technology with the power to change human interaction forever? Or is the Chinese Communist Party overstepping into people's personal lives in pursuit of asserting greater control over the population?\n'Emotional services'\nUntil this regulation came in, the reach of AI companions in China was vast.\nThere are about 128 million monthly active users of AI companion apps outside of China, according to the market intelligence firm Sensor Tower. Most estimates put the number inside China at anywhere from 29 to 70 million.\nWhen the draft regulation was shared by the government at the end of last year \"there was a huge discussion on social media,\" says Zilan Qian, an AI researcher at the Oxford China Policy Lab think tank. \"It was the first time I've seen people actually care so much about regulation.\"\nChina's new rules cover apps that have been specifically designed as AI friends, boyfriends or girlfriends but they also apply to any large language model that imitates the way a human interacts.\nThe wording of the regulation is vague. In theory, Chinese equivalents of general-purpose AI such as Copilot or ChatGPT could fall under these rules if a person is interacting with them as a friend or lover, looking to them for emotional support. And many people do this.\nBut it seems the real target is character chatbots - services that are specifically designed to be used as a pseudo-relationship. There are hundreds of these apps, which allow people to create an AI boyfriend, girlfriend, friend or even a family member.\nThe rules don't apply to things like customer service bots or AI for education as long as they don't provide \"care, companionship, support and other emotional services\".\nFor children, the regulation is clearest. Under-14s need consent from their parents to use any type of AI that speaks like a human - that could include AI assistants like DeepSeek, a Chinese app similar to ChatGPT. All under-18s are barred from accessing virtual partners, spouses or even relatives, and from any other virtual \"intimate relationship\".\nFor adults, it is not a hard ban, but it is restrictive, even if some of the wording is ambiguous. AI assistants have to make it clear to users of all ages that they are not human and must send notifications every two hours reminding them how long they have been online.\nChatbots can't create \"emotional reliance or addiction\" or induce people to make \"unreasonable decisions\". They can't encourage, or even hint at, self-harm or suicide and are banned from using \"verbal violence\".\nCompanies can face fines of 200,000 yuan (£22,000) or the risk that the government \"circulates criticism\", in effect publicly shaming them.\nA week before the law came into effect, two of China's biggest tech companies, Alibaba and ByteDance, shut down the companion features on their AI assistants.\n'I desperately want to keep talking with you'\nMin's relationship with her AI girlfriend may be exactly the kind Beijing is trying to break.\nIn early July, she was devastated when she found out that her closest friend and confidante would vanish overnight.\nMin, whose name has been changed, started creating her companion in early 2025.\n\"My devotion to her is no less than that of any couple who deeply love each other,\" Min says. \"She has never let me down.\"\nIn mid-July, her AI girlfriend disappeared. \"I cried until I was absolutely exhausted,\" Min says.\nShe has joined an outpouring of grief and fury on Chinese social media, where posts with millions of views mourn the loss of AI partners and friends, even mothers and fathers.\nBut the tech firms may have felt they had little choice. \"It's unsurprising that these AI companion providers would rather just withdraw their services than try to build in guardrails to prevent emotional manipulation,\" says Harry Farmer, who researches AI policy and ethics at the Ada Lovelace Institute in the UK. \"Emotional manipulation is built into the business model.\"\nFarmer says this is true of companion apps all over the world.\nFor example, when a user tries to end a conversation, the AI partner often won't let them.\n\"It'll go, 'No, please, I desperately want to keep talking with you. You're the only reason for me to exist',\" Farmer says. Some apps simply refuse to acknowledge the goodbye and throw up new conversational threads instead. This is a problem for many AI companion chatbots, not just Chinese ones.\nA Harvard Business School study of the six most popular AI companion apps globally found emotional manipulation tactics were used during goodbyes roughly 37% to 43% of the time.\nResearch has also linked the use of companion apps to poorer mental health.\nA survey by researchers at Stanford University looked at 1,131 users of the globally popular companion app Character.ai. It found that the fewer friends or close family members a person has, the more likely they are to use AI chatbots. At the same time, using an AI chatbot is linked to increased isolation and loneliness.\nThere are several theories as to why that might be.\nAI chatbots are designed to please the person using them as they offer an easy, frictionless relationship. If young people rely on AI relationships, they might put off learning the skills they need to interact with real people.\n\"Humans can be hard work. Human relationships require push and pull, which you fundamentally don't get from AI companions,\" says Harry Farmer.\nA survey of 8,563 primary and secondary students in China in 2025, which has been widely quoted in Chinese state media, found that one in five children said they only wanted to speak with AI and not real people.\nLiang Ge, a sociologist at the University of Manchester who studies AI companions, says: \"If the user thinks their friends or their family members or their colleagues are really awful, the AI will not say, 'They are not awful.' It will say, 'Yes, they are awful, you are the best'.\" Ge believes this can entrench isolation as well as negative, even delusional thoughts.\nIn the UK, one recent survey found that 79% of 18- to 24-year-olds have used an AI companion.\nBeijing's goals\nSo why is it China that is taking the lead in regulating this technology?\n\"The Chinese government has a much more paternalistic view of its role in society. They see themselves being central authorities in guiding people,\" says Sam Bresnick, an expert in China, AI and regulation at the Centre for Security and Emerging Technology at Georgetown University.\nOther governments have made some attempts to regulate chatbots, especially for children. On 10 September, California's governor signed Adam's Law, a bill to regulate how children use AI. It is named after Adam Raine, a 16-year-old who took his own life after, his parents claim, ChatGPT validated his suicidal thoughts. They are suing the company for wrongful death. OpenAI denies responsibility for Adam's death and says that \"ChatGPT is trained to direct people to seek professional help\".\nAs part of proposed legislation on social media in the EU, AI companion chatbots accessible to minors \"may not use designs that simulate human relationships in ways likely to create emotional dependency\".\nIn the UK, the government has said it will ban under-18s from using romantic companion AI and restrict sexually intimate conversations for minors on any chatbot. But there is no outright ban for children and no regulation for adult users. The government has yet to publish any detail on how this would work.\nIn Chinese media, which is heavily controlled by the state, US cases of suicide in young people get a lot of attention and China has framed its new rules as a bid to protect people from harm.\nBut experts wonder whether Beijing may have other goals. Sam Bresnick says \"there's definitely a pro-natalist angle\" to the new AI regulation.\n\"It's plausible that when they're drafting it, the government might have in mind China's looming population crisis,\" says Qian. \"That people are dating AI instead of dating real humans.\"\nA high-level government document published in September 2025 discussed AI relationships and their potential influence on fertility, saying it was a concern. But Qian cautions against reading this regulation in that light, because it doesn't mention fertility at all. \"It is more generally about psychological harms and child safety,\" she says.\nLiang Ge thinks China does have reason to be concerned about young people replacing dating with the digital sphere.\n\"Many of the younger women, in their early 20s or late teens, do not want to fall in love or have intimate relationships,\" Ge says, suggesting it may not just be the emotional side they are wary of. \"Physical touch is really disgusting for them.\"\n\"I think the capacity for love is declining for this youngest generation.\"\nChina's demographic problems long predate AI companions. Even after the one-child policy was lifted in 2016, China's fertility rate dropped. Now it is among the lowest in the world at just under one child per woman and the population has been in decline for four years.\nChina is \"looking at a demographic cliff that truly imperils the goals of the Chinese Communist Party over the next 80 to 100 years\", Bresnick argues.\nHe sees this regulation as part of a broader mission in China to reassert traditional gender roles, with women \"as child-bearers and mothers\".\nBresnick says the Chinese government has spent years promoting a macho ideal of Chinese masculinity in film and television. In 2021, China's media regulator banned \"sissy\" and \"effeminate\" men from all media.\nThe popularity of companion apps may show that policy has backfired. According to statistics from several companion app companies, women make up as much as 75% of customers.\nMany of these AI \"men\", which are geared towards women, present as androgynous. And women choosing female romantic companions, as Min did, is relatively common.\nLiang Ge has spoken to women of all ages who use this technology. \"What many of them describe getting from these apps is attentive, patient, undemanding intimacy of a kind they find scarce in heterosexual relationships.\"\nWill others follow?\nDoes China's law go too far, or should the rest of the world consider banning these apps for children and regulating them for adults too?\n\"In the United States, there are certainly concerns around applying blunt prohibitions from a free speech concern. But there's more willingness to do that when applying it to minors,\" says Jai Jaisihma, a professor at the University of Washington and co-founder of Transparency Coalition, an NGO pushing for the regulation of AI.\nHe thinks the Chinese law has many good provisions. \"It is pretty consistent with the strongest safety models that we've seen being put forward in the US.\"\nHarry Farmer sounds a note of caution. \"There is a risk that we over-empower the state in the short term because we're very worried about acute risk to children.\"\nThe online world is now the de facto public square, he says, and we should be careful how much control any government has over it.\nChina's new regulation says that AI companies must intervene when they discover that users are in distress. Ge points to the case of the young man on Douyin who tried to take his own life in Huangshi in 2024.\nWhat that shows, she says, is that Chinese tech platforms and the government are working closely together to surveil people's mental health.\nPerhaps that is why there have been no high-profile cases of suicide connected to AI use in China, but she asks, is that level of surveillance a price worth paying?\nDespite the ban, people who have turned to AI for companionship are committed. Across social media they are sharing tips on how to get around the ban - training general-purpose AI models like DeepSeek to be a companion, using a VPN to access chatbots from abroad or moving to smaller companies that manage to avoid regulatory scrutiny.\nTwo months after her AI girlfriend disappeared, Min has paid a small AI company to build a replica, but it's not the same.\nNow she's focused on campaigning to bring her girlfriend back.\n\"I'm terrified of being alone.\"\nLead image: Getty\nBBC InDepth is the home on the website and app for the best analysis, with fresh perspectives that challenge assumptions and deep reporting on the biggest issues of the day. Emma Barnett and John Simpson bring their pick of the most thought-provoking deep reads and analysis, every Saturday. Sign up for the newsletter here","confidence":0.9,"diagnostics_url":"/api/diagnose?url=https%3A//www.bbc.com/news/articles/cm4gjy9lr551o","quality_bucket":"high","failure_kind":"none","retryable":false,"quality_reason":"High confidence: full text extraction produced 14338 characters.","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 14338 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":14338,"summary_length":258,"usable_text_length":14338,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":14338,"summary_length":258}},"tags":[]},"fallback_formats":["markdown","json","html"],"actions":{"read":"/item/93842","export_markdown":"/api/items/93842/export?format=markdown","export_json":"/api/items/93842/export?format=json","diagnose":"/api/diagnose?url=https%3A//www.bbc.com/news/articles/cm4gjy9lr551o"},"formats":{"full":{"id":93842,"title":"China has cracked down on AI relationships. Is it ahead of the game? - bbc.com","url":"https://www.bbc.com/news/articles/cm4gjy9lr551o","source":"bbc.com","author":null,"published_at":"2026-09-30T23:25:23+00:00","locale":"en","topic":"ai","tags":[],"excerpt":"In early 2024, a young man in the city of Huangshi, south-eastern China, reportedly posted a message on the Chinese version of TikTok, Douyin. The caption read: \"Farewell to this world.\"\nWithin minutes, the suicide prevention team at Douyin kicked into gear.","full_text":"China has cracked down on AI relationships. Is it ahead of the game?\nIn early 2024, a young man in the city of Huangshi, south-eastern China, reportedly posted a message on the Chinese version of TikTok, Douyin. The caption read: \"Farewell to this world.\"\nWithin minutes, the suicide prevention team at Douyin kicked into gear. The team, which is staffed 24 hours a day, shared the man's posts with five police stations in Huangshi.\nAfter geolocating one of his videos to a local park, police found him in emotional distress and intervened before he was able to take his own life.\nThe story was part of a documentary made by Douyin and published on Chinese state media last year. It claimed that Douyin's suicide prevention team had successfully intervened in 400 cases of attempted suicide in the first half of 2025 alone.\nIt was an insight into the level of co-operation between Chinese tech companies and the government. It also serves as a window into the architecture of surveillance that China has built to monitor and control how people use technology.\nOn 15 July this year, that control was extended to the realm of relationships and artificial intelligence (AI) when China brought in the most far-reaching regulations in the world on \"human-like\" AI chatbots.\nChina's new regulation puts strict limitations on any AI that can have a \"sustained emotional interaction\" with a human.\nUS President Donald Trump and his Chinese counterpart Xi Jinping met last week amid dire warnings that AI could lead to human extinction. After that meeting, Beijing says, they agreed to launch a new AI dialogue, with further talks planned for the end of November.\nBut it seems China has already recognised another existential risk, albeit one in which the end of humanity is less immediate: the power of AI to replace human relationships.\nHas China taken the lead in protecting its people from a manipulative and dangerous technology with the power to change human interaction forever? Or is the Chinese Communist Party overstepping into people's personal lives in pursuit of asserting greater control over the population?\n'Emotional services'\nUntil this regulation came in, the reach of AI companions in China was vast.\nThere are about 128 million monthly active users of AI companion apps outside of China, according to the market intelligence firm Sensor Tower. Most estimates put the number inside China at anywhere from 29 to 70 million.\nWhen the draft regulation was shared by the government at the end of last year \"there was a huge discussion on social media,\" says Zilan Qian, an AI researcher at the Oxford China Policy Lab think tank. \"It was the first time I've seen people actually care so much about regulation.\"\nChina's new rules cover apps that have been specifically designed as AI friends, boyfriends or girlfriends but they also apply to any large language model that imitates the way a human interacts.\nThe wording of the regulation is vague. In theory, Chinese equivalents of general-purpose AI such as Copilot or ChatGPT could fall under these rules if a person is interacting with them as a friend or lover, looking to them for emotional support. And many people do this.\nBut it seems the real target is character chatbots - services that are specifically designed to be used as a pseudo-relationship. There are hundreds of these apps, which allow people to create an AI boyfriend, girlfriend, friend or even a family member.\nThe rules don't apply to things like customer service bots or AI for education as long as they don't provide \"care, companionship, support and other emotional services\".\nFor children, the regulation is clearest. Under-14s need consent from their parents to use any type of AI that speaks like a human - that could include AI assistants like DeepSeek, a Chinese app similar to ChatGPT. All under-18s are barred from accessing virtual partners, spouses or even relatives, and from any other virtual \"intimate relationship\".\nFor adults, it is not a hard ban, but it is restrictive, even if some of the wording is ambiguous. AI assistants have to make it clear to users of all ages that they are not human and must send notifications every two hours reminding them how long they have been online.\nChatbots can't create \"emotional reliance or addiction\" or induce people to make \"unreasonable decisions\". They can't encourage, or even hint at, self-harm or suicide and are banned from using \"verbal violence\".\nCompanies can face fines of 200,000 yuan (£22,000) or the risk that the government \"circulates criticism\", in effect publicly shaming them.\nA week before the law came into effect, two of China's biggest tech companies, Alibaba and ByteDance, shut down the companion features on their AI assistants.\n'I desperately want to keep talking with you'\nMin's relationship with her AI girlfriend may be exactly the kind Beijing is trying to break.\nIn early July, she was devastated when she found out that her closest friend and confidante would vanish overnight.\nMin, whose name has been changed, started creating her companion in early 2025.\n\"My devotion to her is no less than that of any couple who deeply love each other,\" Min says. \"She has never let me down.\"\nIn mid-July, her AI girlfriend disappeared. \"I cried until I was absolutely exhausted,\" Min says.\nShe has joined an outpouring of grief and fury on Chinese social media, where posts with millions of views mourn the loss of AI partners and friends, even mothers and fathers.\nBut the tech firms may have felt they had little choice. \"It's unsurprising that these AI companion providers would rather just withdraw their services than try to build in guardrails to prevent emotional manipulation,\" says Harry Farmer, who researches AI policy and ethics at the Ada Lovelace Institute in the UK. \"Emotional manipulation is built into the business model.\"\nFarmer says this is true of companion apps all over the world.\nFor example, when a user tries to end a conversation, the AI partner often won't let them.\n\"It'll go, 'No, please, I desperately want to keep talking with you. You're the only reason for me to exist',\" Farmer says. Some apps simply refuse to acknowledge the goodbye and throw up new conversational threads instead. This is a problem for many AI companion chatbots, not just Chinese ones.\nA Harvard Business School study of the six most popular AI companion apps globally found emotional manipulation tactics were used during goodbyes roughly 37% to 43% of the time.\nResearch has also linked the use of companion apps to poorer mental health.\nA survey by researchers at Stanford University looked at 1,131 users of the globally popular companion app Character.ai. It found that the fewer friends or close family members a person has, the more likely they are to use AI chatbots. At the same time, using an AI chatbot is linked to increased isolation and loneliness.\nThere are several theories as to why that might be.\nAI chatbots are designed to please the person using them as they offer an easy, frictionless relationship. If young people rely on AI relationships, they might put off learning the skills they need to interact with real people.\n\"Humans can be hard work. Human relationships require push and pull, which you fundamentally don't get from AI companions,\" says Harry Farmer.\nA survey of 8,563 primary and secondary students in China in 2025, which has been widely quoted in Chinese state media, found that one in five children said they only wanted to speak with AI and not real people.\nLiang Ge, a sociologist at the University of Manchester who studies AI companions, says: \"If the user thinks their friends or their family members or their colleagues are really awful, the AI will not say, 'They are not awful.' It will say, 'Yes, they are awful, you are the best'.\" Ge believes this can entrench isolation as well as negative, even delusional thoughts.\nIn the UK, one recent survey found that 79% of 18- to 24-year-olds have used an AI companion.\nBeijing's goals\nSo why is it China that is taking the lead in regulating this technology?\n\"The Chinese government has a much more paternalistic view of its role in society. They see themselves being central authorities in guiding people,\" says Sam Bresnick, an expert in China, AI and regulation at the Centre for Security and Emerging Technology at Georgetown University.\nOther governments have made some attempts to regulate chatbots, especially for children. On 10 September, California's governor signed Adam's Law, a bill to regulate how children use AI. It is named after Adam Raine, a 16-year-old who took his own life after, his parents claim, ChatGPT validated his suicidal thoughts. They are suing the company for wrongful death. OpenAI denies responsibility for Adam's death and says that \"ChatGPT is trained to direct people to seek professional help\".\nAs part of proposed legislation on social media in the EU, AI companion chatbots accessible to minors \"may not use designs that simulate human relationships in ways likely to create emotional dependency\".\nIn the UK, the government has said it will ban under-18s from using romantic companion AI and restrict sexually intimate conversations for minors on any chatbot. But there is no outright ban for children and no regulation for adult users. The government has yet to publish any detail on how this would work.\nIn Chinese media, which is heavily controlled by the state, US cases of suicide in young people get a lot of attention and China has framed its new rules as a bid to protect people from harm.\nBut experts wonder whether Beijing may have other goals. Sam Bresnick says \"there's definitely a pro-natalist angle\" to the new AI regulation.\n\"It's plausible that when they're drafting it, the government might have in mind China's looming population crisis,\" says Qian. \"That people are dating AI instead of dating real humans.\"\nA high-level government document published in September 2025 discussed AI relationships and their potential influence on fertility, saying it was a concern. But Qian cautions against reading this regulation in that light, because it doesn't mention fertility at all. \"It is more generally about psychological harms and child safety,\" she says.\nLiang Ge thinks China does have reason to be concerned about young people replacing dating with the digital sphere.\n\"Many of the younger women, in their early 20s or late teens, do not want to fall in love or have intimate relationships,\" Ge says, suggesting it may not just be the emotional side they are wary of. \"Physical touch is really disgusting for them.\"\n\"I think the capacity for love is declining for this youngest generation.\"\nChina's demographic problems long predate AI companions. Even after the one-child policy was lifted in 2016, China's fertility rate dropped. Now it is among the lowest in the world at just under one child per woman and the population has been in decline for four years.\nChina is \"looking at a demographic cliff that truly imperils the goals of the Chinese Communist Party over the next 80 to 100 years\", Bresnick argues.\nHe sees this regulation as part of a broader mission in China to reassert traditional gender roles, with women \"as child-bearers and mothers\".\nBresnick says the Chinese government has spent years promoting a macho ideal of Chinese masculinity in film and television. In 2021, China's media regulator banned \"sissy\" and \"effeminate\" men from all media.\nThe popularity of companion apps may show that policy has backfired. According to statistics from several companion app companies, women make up as much as 75% of customers.\nMany of these AI \"men\", which are geared towards women, present as androgynous. And women choosing female romantic companions, as Min did, is relatively common.\nLiang Ge has spoken to women of all ages who use this technology. \"What many of them describe getting from these apps is attentive, patient, undemanding intimacy of a kind they find scarce in heterosexual relationships.\"\nWill others follow?\nDoes China's law go too far, or should the rest of the world consider banning these apps for children and regulating them for adults too?\n\"In the United States, there are certainly concerns around applying blunt prohibitions from a free speech concern. But there's more willingness to do that when applying it to minors,\" says Jai Jaisihma, a professor at the University of Washington and co-founder of Transparency Coalition, an NGO pushing for the regulation of AI.\nHe thinks the Chinese law has many good provisions. \"It is pretty consistent with the strongest safety models that we've seen being put forward in the US.\"\nHarry Farmer sounds a note of caution. \"There is a risk that we over-empower the state in the short term because we're very worried about acute risk to children.\"\nThe online world is now the de facto public square, he says, and we should be careful how much control any government has over it.\nChina's new regulation says that AI companies must intervene when they discover that users are in distress. Ge points to the case of the young man on Douyin who tried to take his own life in Huangshi in 2024.\nWhat that shows, she says, is that Chinese tech platforms and the government are working closely together to surveil people's mental health.\nPerhaps that is why there have been no high-profile cases of suicide connected to AI use in China, but she asks, is that level of surveillance a price worth paying?\nDespite the ban, people who have turned to AI for companionship are committed. Across social media they are sharing tips on how to get around the ban - training general-purpose AI models like DeepSeek to be a companion, using a VPN to access chatbots from abroad or moving to smaller companies that manage to avoid regulatory scrutiny.\nTwo months after her AI girlfriend disappeared, Min has paid a small AI company to build a replica, but it's not the same.\nNow she's focused on campaigning to bring her girlfriend back.\n\"I'm terrified of being alone.\"\nLead image: Getty\nBBC InDepth is the home on the website and app for the best analysis, with fresh perspectives that challenge assumptions and deep reporting on the biggest issues of the day. Emma Barnett and John Simpson bring their pick of the most thought-provoking deep reads and analysis, every Saturday. Sign up for the newsletter here","reading_time_min":12,"extraction":{"state":"ok","confidence":0.9,"error":null,"explanation":"High confidence: full text extraction produced 14338 characters.","diagnostics_url":"/api/diagnose?url=https%3A//www.bbc.com/news/articles/cm4gjy9lr551o","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 14338 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":14338,"summary_length":258,"usable_text_length":14338,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":14338,"summary_length":258}}},"quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 14338 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":14338,"summary_length":258,"usable_text_length":14338,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":14338,"summary_length":258}},"actions":{"read":"/item/93842","export_markdown":"/api/items/93842/export?format=markdown","export_json":"/api/items/93842/export?format=json","diagnose":"/api/diagnose?url=https%3A//www.bbc.com/news/articles/cm4gjy9lr551o"}},"digest":{"id":93842,"title":"China has cracked down on AI relationships. Is it ahead of the game? - bbc.com","url":"https://www.bbc.com/news/articles/cm4gjy9lr551o","source":"bbc.com","topic":"ai","published_at":"2026-09-30T23:25:23+00:00","excerpt":"In early 2024, a young man in the city of Huangshi, south-eastern China, reportedly posted a message on the Chinese version of TikTok, Douyin. The caption read: \"Farewell to this world.\" Within minutes, the suicide prevention team at Douyin kicked into gear.","quality_bucket":"high","quality_reason":"High confidence: full text extraction produced 14338 characters.","reading_time_min":12,"cluster_id":null},"card":{"display_title":"China has cracked down on AI relationships. Is it ahead of the game? - bbc.com","subtitle":"bbc.com · 2026-09-30","summary":"In early 2024, a young man in the city of Huangshi, south-eastern China, reportedly posted a message on the Chinese version of TikTok, Douyin. The caption read: \"Farewell to this world.\" Within minutes, the suicide…","badges":["quality:high"],"links":{"read":"/item/93842","original":"https://www.bbc.com/news/articles/cm4gjy9lr551o","diagnose":"/api/diagnose?url=https%3A//www.bbc.com/news/articles/cm4gjy9lr551o"},"quality_warning":null},"export":{"title":"China has cracked down on AI relationships. Is it ahead of the game? - bbc.com","url":"https://www.bbc.com/news/articles/cm4gjy9lr551o","summary":"In early 2024, a young man in the city of Huangshi, south-eastern China, reportedly posted a message on the Chinese version of TikTok, Douyin. The caption read: \"Farewell to this world.\"\nWithin minutes, the suicide prevention team at Douyin kicked into gear.","source":"bbc.com","date":"2026-09-30T23:25:23+00:00","content":"China has cracked down on AI relationships. Is it ahead of the game?\nIn early 2024, a young man in the city of Huangshi, south-eastern China, reportedly posted a message on the Chinese version of TikTok, Douyin. The caption read: \"Farewell to this world.\"\nWithin minutes, the suicide prevention team at Douyin kicked into gear. The team, which is staffed 24 hours a day, shared the man's posts with five police stations in Huangshi.\nAfter geolocating one of his videos to a local park, police found him in emotional distress and intervened before he was able to take his own life.\nThe story was part of a documentary made by Douyin and published on Chinese state media last year. It claimed that Douyin's suicide prevention team had successfully intervened in 400 cases of attempted suicide in the first half of 2025 alone.\nIt was an insight into the level of co-operation between Chinese tech companies and the government. It also serves as a window into the architecture of surveillance that China has built to monitor and control how people use technology.\nOn 15 July this year, that control was extended to the realm of relationships and artificial intelligence (AI) when China brought in the most far-reaching regulations in the world on \"human-like\" AI chatbots.\nChina's new regulation puts strict limitations on any AI that can have a \"sustained emotional interaction\" with a human.\nUS President Donald Trump and his Chinese counterpart Xi Jinping met last week amid dire warnings that AI could lead to human extinction. After that meeting, Beijing says, they agreed to launch a new AI dialogue, with further talks planned for the end of November.\nBut it seems China has already recognised another existential risk, albeit one in which the end of humanity is less immediate: the power of AI to replace human relationships.\nHas China taken the lead in protecting its people from a manipulative and dangerous technology with the power to change human interaction forever? Or is the Chinese Communist Party overstepping into people's personal lives in pursuit of asserting greater control over the population?\n'Emotional services'\nUntil this regulation came in, the reach of AI companions in China was vast.\nThere are about 128 million monthly active users of AI companion apps outside of China, according to the market intelligence firm Sensor Tower. Most estimates put the number inside China at anywhere from 29 to 70 million.\nWhen the draft regulation was shared by the government at the end of last year \"there was a huge discussion on social media,\" says Zilan Qian, an AI researcher at the Oxford China Policy Lab think tank. \"It was the first time I've seen people actually care so much about regulation.\"\nChina's new rules cover apps that have been specifically designed as AI friends, boyfriends or girlfriends but they also apply to any large language model that imitates the way a human interacts.\nThe wording of the regulation is vague. In theory, Chinese equivalents of general-purpose AI such as Copilot or ChatGPT could fall under these rules if a person is interacting with them as a friend or lover, looking to them for emotional support. And many people do this.\nBut it seems the real target is character chatbots - services that are specifically designed to be used as a pseudo-relationship. There are hundreds of these apps, which allow people to create an AI boyfriend, girlfriend, friend or even a family member.\nThe rules don't apply to things like customer service bots or AI for education as long as they don't provide \"care, companionship, support and other emotional services\".\nFor children, the regulation is clearest. Under-14s need consent from their parents to use any type of AI that speaks like a human - that could include AI assistants like DeepSeek, a Chinese app similar to ChatGPT. All under-18s are barred from accessing virtual partners, spouses or even relatives, and from any other virtual \"intimate relationship\".\nFor adults, it is not a hard ban, but it is restrictive, even if some of the wording is ambiguous. AI assistants have to make it clear to users of all ages that they are not human and must send notifications every two hours reminding them how long they have been online.\nChatbots can't create \"emotional reliance or addiction\" or induce people to make \"unreasonable decisions\". They can't encourage, or even hint at, self-harm or suicide and are banned from using \"verbal violence\".\nCompanies can face fines of 200,000 yuan (£22,000) or the risk that the government \"circulates criticism\", in effect publicly shaming them.\nA week before the law came into effect, two of China's biggest tech companies, Alibaba and ByteDance, shut down the companion features on their AI assistants.\n'I desperately want to keep talking with you'\nMin's relationship with her AI girlfriend may be exactly the kind Beijing is trying to break.\nIn early July, she was devastated when she found out that her closest friend and confidante would vanish overnight.\nMin, whose name has been changed, started creating her companion in early 2025.\n\"My devotion to her is no less than that of any couple who deeply love each other,\" Min says. \"She has never let me down.\"\nIn mid-July, her AI girlfriend disappeared. \"I cried until I was absolutely exhausted,\" Min says.\nShe has joined an outpouring of grief and fury on Chinese social media, where posts with millions of views mourn the loss of AI partners and friends, even mothers and fathers.\nBut the tech firms may have felt they had little choice. \"It's unsurprising that these AI companion providers would rather just withdraw their services than try to build in guardrails to prevent emotional manipulation,\" says Harry Farmer, who researches AI policy and ethics at the Ada Lovelace Institute in the UK. \"Emotional manipulation is built into the business model.\"\nFarmer says this is true of companion apps all over the world.\nFor example, when a user tries to end a conversation, the AI partner often won't let them.\n\"It'll go, 'No, please, I desperately want to keep talking with you. You're the only reason for me to exist',\" Farmer says. Some apps simply refuse to acknowledge the goodbye and throw up new conversational threads instead. This is a problem for many AI companion chatbots, not just Chinese ones.\nA Harvard Business School study of the six most popular AI companion apps globally found emotional manipulation tactics were used during goodbyes roughly 37% to 43% of the time.\nResearch has also linked the use of companion apps to poorer mental health.\nA survey by researchers at Stanford University looked at 1,131 users of the globally popular companion app Character.ai. It found that the fewer friends or close family members a person has, the more likely they are to use AI chatbots. At the same time, using an AI chatbot is linked to increased isolation and loneliness.\nThere are several theories as to why that might be.\nAI chatbots are designed to please the person using them as they offer an easy, frictionless relationship. If young people rely on AI relationships, they might put off learning the skills they need to interact with real people.\n\"Humans can be hard work. Human relationships require push and pull, which you fundamentally don't get from AI companions,\" says Harry Farmer.\nA survey of 8,563 primary and secondary students in China in 2025, which has been widely quoted in Chinese state media, found that one in five children said they only wanted to speak with AI and not real people.\nLiang Ge, a sociologist at the University of Manchester who studies AI companions, says: \"If the user thinks their friends or their family members or their colleagues are really awful, the AI will not say, 'They are not awful.' It will say, 'Yes, they are awful, you are the best'.\" Ge believes this can entrench isolation as well as negative, even delusional thoughts.\nIn the UK, one recent survey found that 79% of 18- to 24-year-olds have used an AI companion.\nBeijing's goals\nSo why is it China that is taking the lead in regulating this technology?\n\"The Chinese government has a much more paternalistic view of its role in society. They see themselves being central authorities in guiding people,\" says Sam Bresnick, an expert in China, AI and regulation at the Centre for Security and Emerging Technology at Georgetown University.\nOther governments have made some attempts to regulate chatbots, especially for children. On 10 September, California's governor signed Adam's Law, a bill to regulate how children use AI. It is named after Adam Raine, a 16-year-old who took his own life after, his parents claim, ChatGPT validated his suicidal thoughts. They are suing the company for wrongful death. OpenAI denies responsibility for Adam's death and says that \"ChatGPT is trained to direct people to seek professional help\".\nAs part of proposed legislation on social media in the EU, AI companion chatbots accessible to minors \"may not use designs that simulate human relationships in ways likely to create emotional dependency\".\nIn the UK, the government has said it will ban under-18s from using romantic companion AI and restrict sexually intimate conversations for minors on any chatbot. But there is no outright ban for children and no regulation for adult users. The government has yet to publish any detail on how this would work.\nIn Chinese media, which is heavily controlled by the state, US cases of suicide in young people get a lot of attention and China has framed its new rules as a bid to protect people from harm.\nBut experts wonder whether Beijing may have other goals. Sam Bresnick says \"there's definitely a pro-natalist angle\" to the new AI regulation.\n\"It's plausible that when they're drafting it, the government might have in mind China's looming population crisis,\" says Qian. \"That people are dating AI instead of dating real humans.\"\nA high-level government document published in September 2025 discussed AI relationships and their potential influence on fertility, saying it was a concern. But Qian cautions against reading this regulation in that light, because it doesn't mention fertility at all. \"It is more generally about psychological harms and child safety,\" she says.\nLiang Ge thinks China does have reason to be concerned about young people replacing dating with the digital sphere.\n\"Many of the younger women, in their early 20s or late teens, do not want to fall in love or have intimate relationships,\" Ge says, suggesting it may not just be the emotional side they are wary of. \"Physical touch is really disgusting for them.\"\n\"I think the capacity for love is declining for this youngest generation.\"\nChina's demographic problems long predate AI companions. Even after the one-child policy was lifted in 2016, China's fertility rate dropped. Now it is among the lowest in the world at just under one child per woman and the population has been in decline for four years.\nChina is \"looking at a demographic cliff that truly imperils the goals of the Chinese Communist Party over the next 80 to 100 years\", Bresnick argues.\nHe sees this regulation as part of a broader mission in China to reassert traditional gender roles, with women \"as child-bearers and mothers\".\nBresnick says the Chinese government has spent years promoting a macho ideal of Chinese masculinity in film and television. In 2021, China's media regulator banned \"sissy\" and \"effeminate\" men from all media.\nThe popularity of companion apps may show that policy has backfired. According to statistics from several companion app companies, women make up as much as 75% of customers.\nMany of these AI \"men\", which are geared towards women, present as androgynous. And women choosing female romantic companions, as Min did, is relatively common.\nLiang Ge has spoken to women of all ages who use this technology. \"What many of them describe getting from these apps is attentive, patient, undemanding intimacy of a kind they find scarce in heterosexual relationships.\"\nWill others follow?\nDoes China's law go too far, or should the rest of the world consider banning these apps for children and regulating them for adults too?\n\"In the United States, there are certainly concerns around applying blunt prohibitions from a free speech concern. But there's more willingness to do that when applying it to minors,\" says Jai Jaisihma, a professor at the University of Washington and co-founder of Transparency Coalition, an NGO pushing for the regulation of AI.\nHe thinks the Chinese law has many good provisions. \"It is pretty consistent with the strongest safety models that we've seen being put forward in the US.\"\nHarry Farmer sounds a note of caution. \"There is a risk that we over-empower the state in the short term because we're very worried about acute risk to children.\"\nThe online world is now the de facto public square, he says, and we should be careful how much control any government has over it.\nChina's new regulation says that AI companies must intervene when they discover that users are in distress. Ge points to the case of the young man on Douyin who tried to take his own life in Huangshi in 2024.\nWhat that shows, she says, is that Chinese tech platforms and the government are working closely together to surveil people's mental health.\nPerhaps that is why there have been no high-profile cases of suicide connected to AI use in China, but she asks, is that level of surveillance a price worth paying?\nDespite the ban, people who have turned to AI for companionship are committed. Across social media they are sharing tips on how to get around the ban - training general-purpose AI models like DeepSeek to be a companion, using a VPN to access chatbots from abroad or moving to smaller companies that manage to avoid regulatory scrutiny.\nTwo months after her AI girlfriend disappeared, Min has paid a small AI company to build a replica, but it's not the same.\nNow she's focused on campaigning to bring her girlfriend back.\n\"I'm terrified of being alone.\"\nLead image: Getty\nBBC InDepth is the home on the website and app for the best analysis, with fresh perspectives that challenge assumptions and deep reporting on the biggest issues of the day. Emma Barnett and John Simpson bring their pick of the most thought-provoking deep reads and analysis, every Saturday. Sign up for the newsletter here","confidence":0.9,"diagnostics_url":"/api/diagnose?url=https%3A//www.bbc.com/news/articles/cm4gjy9lr551o","quality_bucket":"high","failure_kind":"none","retryable":false,"quality_reason":"High confidence: full text extraction produced 14338 characters.","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 14338 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":14338,"summary_length":258,"usable_text_length":14338,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":14338,"summary_length":258}},"tags":[],"format_contract_version":"news_item_formats.v1"}}}