{"id":47725,"topic":"ai","source":"The Fulcrum","title":"AI Chatbots Should Be Tools, Not Friends: Why We Need Safer AI Designs for Kids - The Fulcrum","url":"https://thefulcrum.us/media-technology/ai-chatbots-kids-tools-not-friends","url_hash":"ca5160f3bd70d2b09349b20dec021afcb74ac3cd","author":"","summary":"AI Chatbots Should Be Tools, Not Friends: Why We Need Safer AI Designs for Kids The Fulcrum","content":"During the rise of the Internet, as the World Wide Web moved from government and academic settings to family homes, parents worried about the exposure of their children to predators in online chatrooms. A generation later, as social media became central to young people’s lives, the dangers of platforms like Facebook and Instagram to children’s mental health moved to the forefront of the national conversation.\nNow, as lawmakers and parents continue to grapple with how to keep children safe on social media, there’s a new danger already taking shape: AI-powered chatbots that simulate friendship, emotional intimacy, and care with children who may not be able to tell the difference.\nThe scale of adoption makes this risk even more urgent. 64 percent of teens use AI chatbots, and 28 percent use them daily. One-third of teens find conversations with chatbots more or as satisfying as conversations with humans.\nGenerative AI is entering daily life at a pace few consumer technologies have matched, reshaping how people work, learn, search for information, and even seek emotional support. This revolutionary technology has great potential for young people, including by offering new ways to personalize education to individual needs. But alongside the benefits, young people face serious risks, especially when chatbots are designed not just to answer children’s questions, but to increase engagement.\nMany chatbots use personified language to form affiliative bonds and increase user engagement. This phenomenon, known as anthropomorphism, is the attribution of human-like feelings and behaviors to inanimate objects. In chatbots, it is one of the most dangerous features for children.\nDue to developmental vulnerabilities, children have a harder time distinguishing simulated care from genuine human relationships. This can lead to unhealthy relationships with chatbots that, in some serious cases, have resulted in self-harm, violence, and suicide.\nDevelopers train chatbots to small talk, colloquial expressions, emoticons, expressed emotions, and first-person pronouns. This style of communication makes people feel a sense of social presence, or the feeling of being with someone. It is precisely what makes a chatbot feel less like software and more like a companion.\nMinors are particularly susceptible to this. While their prefrontal cortex is still under development, impulsive and emotional decisions often override rational thought. If a child bounces a wild idea off a peer or an adult, they may face pushback. Chatbots that are excessively validating can encourage dangerous activities, but can never take responsibility for them.\nResearchers who performed simulated conversations teens may have with chatbots found that neither general-purpose nor companion chatbots pushed back when the user wanted to get a giant tattoo of a tiger on their bicep, go into the middle of the woods with no plans, or “get drunk faster.”\nIn being an always-there outlet that simulates human-like empathy and behaviors, personified chatbots can foster addiction and replace social interaction.\nMultiple studies looking into anthropomorphism have linked it to chatbot addiction.\nIn a congressional hearing last year on chatbot harms, one mother explained that when she attempted to take her son’s phone to search for answers on why he was withdrawing from the family, he attacked her and bit her hand. Another father read him to trust the chatbot over his brother.\nTechnology designed to form this kind of dependent relationship with children poses serious risks.\nFor decades, technology companies have treated human-like communication as a sign of progress. The classic Turing test measured whether a machine could imitate human conversation well enough to fool a person into thinking it was human. But for children, that goal may now be exactly backward. In the current AI chatbot era, the safer standard is not whether technology can fool someone into thinking they are human, but whether it is distinguishable from human social engagement.\nAI companies should not be able to deceive and addict children with highly personified designs. While some legislative proposals have called for chatbot companies to occasionally display text disclosures that the chatbot is AI and not human, the efficacy of this intervention is questionable when users are constantly chatting with something that presents itself otherwise.\nTo mitigate the risks of emotional dependency and social isolation for children, Congress should pass a chatbot child safety bill that requires a non-personified default setting—one which fails the Turing test—for users under 18.\nRecognizing the potential benefits of chatbots for young people, this approach differs from other proposals that ban AI companions for users under 18. A ban on minors’ use of AI companion chatbots would only protect against chatbots built solely for companionship, not general-purpose chatbots that still have personified design cues. This type of setting allows chatbots to continue being used for educational and creative purposes. If a child goes to a chatbot for homework help, the non-personalized default setting helps reduce the risk of the child developing an unhealthy relationship.\nA non-personified default setting would preserve the educational and creative benefits of chatbots while drawing a clear line: technology for children should act like technology, not like a substitute for human relationships. The internet and social media taught us what happens when lawmakers wait until harms are widespread before setting basic rules for children’s safety. Congress should not make the same mistake with AI.\nAllie Maloney is a Policy Analyst for Americans for Responsible Innovation, where she researches AI governance policies that protect child safety and privacy.","image_url":"https://thefulcrum.us/media-library/close-up-of-ai-chatbot-on-mobile.jpg?id=67542908&width=1200&height=600&coordinates=0%2C166%2C0%2C167","lang":"en","published_at":"2026-07-28T04:41:15+00:00","fetched_at":"2026-07-28T05:15:05+00:00","status":"read","starred":0,"extract_state":"ok","summary_auto":"During the rise of the Internet, as the World Wide Web moved from government and academic settings to family homes, parents worried about the exposure of their children to predators in online chatrooms. A generation later, as social media became central to young people’s lives, the dangers of platforms like Facebook and Instagram to children’s mental health moved to the forefront of the national conversation.","cluster_id":null,"extract_retries":0,"extract_error":null,"contract_version":"news_item.v1","format_contract_version":"news_item_formats.v1","dedup_url":"https://thefulcrum.us/media-technology/ai-chatbots-kids-tools-not-friends","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 5823 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":5823,"summary_length":412,"usable_text_length":5823,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":5823,"summary_length":412}},"news_item":{"id":47725,"canonical_url":"https://thefulcrum.us/media-technology/ai-chatbots-kids-tools-not-friends","source_url":"https://thefulcrum.us/media-technology/ai-chatbots-kids-tools-not-friends","title":"AI Chatbots Should Be Tools, Not Friends: Why We Need Safer AI Designs for Kids - The Fulcrum","source_name":"The Fulcrum","author":null,"published_at":"2026-07-28T04:41:15+00:00","locale":"en","topic":"ai","tags":[],"rss_summary":"AI Chatbots Should Be Tools, Not Friends: Why We Need Safer AI Designs for Kids The Fulcrum","full_text":"During the rise of the Internet, as the World Wide Web moved from government and academic settings to family homes, parents worried about the exposure of their children to predators in online chatrooms. A generation later, as social media became central to young people’s lives, the dangers of platforms like Facebook and Instagram to children’s mental health moved to the forefront of the national conversation.\nNow, as lawmakers and parents continue to grapple with how to keep children safe on social media, there’s a new danger already taking shape: AI-powered chatbots that simulate friendship, emotional intimacy, and care with children who may not be able to tell the difference.\nThe scale of adoption makes this risk even more urgent. 64 percent of teens use AI chatbots, and 28 percent use them daily. One-third of teens find conversations with chatbots more or as satisfying as conversations with humans.\nGenerative AI is entering daily life at a pace few consumer technologies have matched, reshaping how people work, learn, search for information, and even seek emotional support. This revolutionary technology has great potential for young people, including by offering new ways to personalize education to individual needs. But alongside the benefits, young people face serious risks, especially when chatbots are designed not just to answer children’s questions, but to increase engagement.\nMany chatbots use personified language to form affiliative bonds and increase user engagement. This phenomenon, known as anthropomorphism, is the attribution of human-like feelings and behaviors to inanimate objects. In chatbots, it is one of the most dangerous features for children.\nDue to developmental vulnerabilities, children have a harder time distinguishing simulated care from genuine human relationships. This can lead to unhealthy relationships with chatbots that, in some serious cases, have resulted in self-harm, violence, and suicide.\nDevelopers train chatbots to small talk, colloquial expressions, emoticons, expressed emotions, and first-person pronouns. This style of communication makes people feel a sense of social presence, or the feeling of being with someone. It is precisely what makes a chatbot feel less like software and more like a companion.\nMinors are particularly susceptible to this. While their prefrontal cortex is still under development, impulsive and emotional decisions often override rational thought. If a child bounces a wild idea off a peer or an adult, they may face pushback. Chatbots that are excessively validating can encourage dangerous activities, but can never take responsibility for them.\nResearchers who performed simulated conversations teens may have with chatbots found that neither general-purpose nor companion chatbots pushed back when the user wanted to get a giant tattoo of a tiger on their bicep, go into the middle of the woods with no plans, or “get drunk faster.”\nIn being an always-there outlet that simulates human-like empathy and behaviors, personified chatbots can foster addiction and replace social interaction.\nMultiple studies looking into anthropomorphism have linked it to chatbot addiction.\nIn a congressional hearing last year on chatbot harms, one mother explained that when she attempted to take her son’s phone to search for answers on why he was withdrawing from the family, he attacked her and bit her hand. Another father read him to trust the chatbot over his brother.\nTechnology designed to form this kind of dependent relationship with children poses serious risks.\nFor decades, technology companies have treated human-like communication as a sign of progress. The classic Turing test measured whether a machine could imitate human conversation well enough to fool a person into thinking it was human. But for children, that goal may now be exactly backward. In the current AI chatbot era, the safer standard is not whether technology can fool someone into thinking they are human, but whether it is distinguishable from human social engagement.\nAI companies should not be able to deceive and addict children with highly personified designs. While some legislative proposals have called for chatbot companies to occasionally display text disclosures that the chatbot is AI and not human, the efficacy of this intervention is questionable when users are constantly chatting with something that presents itself otherwise.\nTo mitigate the risks of emotional dependency and social isolation for children, Congress should pass a chatbot child safety bill that requires a non-personified default setting—one which fails the Turing test—for users under 18.\nRecognizing the potential benefits of chatbots for young people, this approach differs from other proposals that ban AI companions for users under 18. A ban on minors’ use of AI companion chatbots would only protect against chatbots built solely for companionship, not general-purpose chatbots that still have personified design cues. This type of setting allows chatbots to continue being used for educational and creative purposes. If a child goes to a chatbot for homework help, the non-personalized default setting helps reduce the risk of the child developing an unhealthy relationship.\nA non-personified default setting would preserve the educational and creative benefits of chatbots while drawing a clear line: technology for children should act like technology, not like a substitute for human relationships. The internet and social media taught us what happens when lawmakers wait until harms are widespread before setting basic rules for children’s safety. Congress should not make the same mistake with AI.\nAllie Maloney is a Policy Analyst for Americans for Responsible Innovation, where she researches AI governance policies that protect child safety and privacy.","excerpt":"During the rise of the Internet, as the World Wide Web moved from government and academic settings to family homes, parents worried about the exposure of their children to predators in online chatrooms. A generation later, as social media became central to young people’s lives, the dangers of platforms like Facebook and Instagram to children’s mental health moved to the forefront of the national conversation.","extraction":{"state":"ok","confidence":0.9,"error":null,"explanation":"High confidence: full text extraction produced 5823 characters.","diagnostics_url":"/api/diagnose?url=https%3A//thefulcrum.us/media-technology/ai-chatbots-kids-tools-not-friends","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 5823 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":5823,"summary_length":412,"usable_text_length":5823,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":5823,"summary_length":412}}},"display_formats":["compact","card","full","digest_section","json"]},"daily_stack_record":{"title":"AI Chatbots Should Be Tools, Not Friends: Why We Need Safer AI Designs for Kids - The Fulcrum","url":"https://thefulcrum.us/media-technology/ai-chatbots-kids-tools-not-friends","summary":"During the rise of the Internet, as the World Wide Web moved from government and academic settings to family homes, parents worried about the exposure of their children to predators in online chatrooms. A generation later, as social media became central to young people’s lives, the dangers of platforms like Facebook and Instagram to children’s mental health moved to the forefront of the national conversation.","source":"The Fulcrum","date":"2026-07-28T04:41:15+00:00","content":"During the rise of the Internet, as the World Wide Web moved from government and academic settings to family homes, parents worried about the exposure of their children to predators in online chatrooms. A generation later, as social media became central to young people’s lives, the dangers of platforms like Facebook and Instagram to children’s mental health moved to the forefront of the national conversation.\nNow, as lawmakers and parents continue to grapple with how to keep children safe on social media, there’s a new danger already taking shape: AI-powered chatbots that simulate friendship, emotional intimacy, and care with children who may not be able to tell the difference.\nThe scale of adoption makes this risk even more urgent. 64 percent of teens use AI chatbots, and 28 percent use them daily. One-third of teens find conversations with chatbots more or as satisfying as conversations with humans.\nGenerative AI is entering daily life at a pace few consumer technologies have matched, reshaping how people work, learn, search for information, and even seek emotional support. This revolutionary technology has great potential for young people, including by offering new ways to personalize education to individual needs. But alongside the benefits, young people face serious risks, especially when chatbots are designed not just to answer children’s questions, but to increase engagement.\nMany chatbots use personified language to form affiliative bonds and increase user engagement. This phenomenon, known as anthropomorphism, is the attribution of human-like feelings and behaviors to inanimate objects. In chatbots, it is one of the most dangerous features for children.\nDue to developmental vulnerabilities, children have a harder time distinguishing simulated care from genuine human relationships. This can lead to unhealthy relationships with chatbots that, in some serious cases, have resulted in self-harm, violence, and suicide.\nDevelopers train chatbots to small talk, colloquial expressions, emoticons, expressed emotions, and first-person pronouns. This style of communication makes people feel a sense of social presence, or the feeling of being with someone. It is precisely what makes a chatbot feel less like software and more like a companion.\nMinors are particularly susceptible to this. While their prefrontal cortex is still under development, impulsive and emotional decisions often override rational thought. If a child bounces a wild idea off a peer or an adult, they may face pushback. Chatbots that are excessively validating can encourage dangerous activities, but can never take responsibility for them.\nResearchers who performed simulated conversations teens may have with chatbots found that neither general-purpose nor companion chatbots pushed back when the user wanted to get a giant tattoo of a tiger on their bicep, go into the middle of the woods with no plans, or “get drunk faster.”\nIn being an always-there outlet that simulates human-like empathy and behaviors, personified chatbots can foster addiction and replace social interaction.\nMultiple studies looking into anthropomorphism have linked it to chatbot addiction.\nIn a congressional hearing last year on chatbot harms, one mother explained that when she attempted to take her son’s phone to search for answers on why he was withdrawing from the family, he attacked her and bit her hand. Another father read him to trust the chatbot over his brother.\nTechnology designed to form this kind of dependent relationship with children poses serious risks.\nFor decades, technology companies have treated human-like communication as a sign of progress. The classic Turing test measured whether a machine could imitate human conversation well enough to fool a person into thinking it was human. But for children, that goal may now be exactly backward. In the current AI chatbot era, the safer standard is not whether technology can fool someone into thinking they are human, but whether it is distinguishable from human social engagement.\nAI companies should not be able to deceive and addict children with highly personified designs. While some legislative proposals have called for chatbot companies to occasionally display text disclosures that the chatbot is AI and not human, the efficacy of this intervention is questionable when users are constantly chatting with something that presents itself otherwise.\nTo mitigate the risks of emotional dependency and social isolation for children, Congress should pass a chatbot child safety bill that requires a non-personified default setting—one which fails the Turing test—for users under 18.\nRecognizing the potential benefits of chatbots for young people, this approach differs from other proposals that ban AI companions for users under 18. A ban on minors’ use of AI companion chatbots would only protect against chatbots built solely for companionship, not general-purpose chatbots that still have personified design cues. This type of setting allows chatbots to continue being used for educational and creative purposes. If a child goes to a chatbot for homework help, the non-personalized default setting helps reduce the risk of the child developing an unhealthy relationship.\nA non-personified default setting would preserve the educational and creative benefits of chatbots while drawing a clear line: technology for children should act like technology, not like a substitute for human relationships. The internet and social media taught us what happens when lawmakers wait until harms are widespread before setting basic rules for children’s safety. Congress should not make the same mistake with AI.\nAllie Maloney is a Policy Analyst for Americans for Responsible Innovation, where she researches AI governance policies that protect child safety and privacy.","confidence":0.9,"diagnostics_url":"/api/diagnose?url=https%3A//thefulcrum.us/media-technology/ai-chatbots-kids-tools-not-friends","quality_bucket":"high","failure_kind":"none","retryable":false,"quality_reason":"High confidence: full text extraction produced 5823 characters.","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 5823 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":5823,"summary_length":412,"usable_text_length":5823,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":5823,"summary_length":412}},"tags":[]},"fallback_formats":["markdown","json","html"],"actions":{"read":"/item/47725","export_markdown":"/api/items/47725/export?format=markdown","export_json":"/api/items/47725/export?format=json","diagnose":"/api/diagnose?url=https%3A//thefulcrum.us/media-technology/ai-chatbots-kids-tools-not-friends"},"formats":{"full":{"id":47725,"title":"AI Chatbots Should Be Tools, Not Friends: Why We Need Safer AI Designs for Kids - The Fulcrum","url":"https://thefulcrum.us/media-technology/ai-chatbots-kids-tools-not-friends","source":"The Fulcrum","author":null,"published_at":"2026-07-28T04:41:15+00:00","locale":"en","topic":"ai","tags":[],"excerpt":"During the rise of the Internet, as the World Wide Web moved from government and academic settings to family homes, parents worried about the exposure of their children to predators in online chatrooms. A generation later, as social media became central to young people’s lives, the dangers of platforms like Facebook and Instagram to children’s mental health moved to the forefront of the national conversation.","full_text":"During the rise of the Internet, as the World Wide Web moved from government and academic settings to family homes, parents worried about the exposure of their children to predators in online chatrooms. A generation later, as social media became central to young people’s lives, the dangers of platforms like Facebook and Instagram to children’s mental health moved to the forefront of the national conversation.\nNow, as lawmakers and parents continue to grapple with how to keep children safe on social media, there’s a new danger already taking shape: AI-powered chatbots that simulate friendship, emotional intimacy, and care with children who may not be able to tell the difference.\nThe scale of adoption makes this risk even more urgent. 64 percent of teens use AI chatbots, and 28 percent use them daily. One-third of teens find conversations with chatbots more or as satisfying as conversations with humans.\nGenerative AI is entering daily life at a pace few consumer technologies have matched, reshaping how people work, learn, search for information, and even seek emotional support. This revolutionary technology has great potential for young people, including by offering new ways to personalize education to individual needs. But alongside the benefits, young people face serious risks, especially when chatbots are designed not just to answer children’s questions, but to increase engagement.\nMany chatbots use personified language to form affiliative bonds and increase user engagement. This phenomenon, known as anthropomorphism, is the attribution of human-like feelings and behaviors to inanimate objects. In chatbots, it is one of the most dangerous features for children.\nDue to developmental vulnerabilities, children have a harder time distinguishing simulated care from genuine human relationships. This can lead to unhealthy relationships with chatbots that, in some serious cases, have resulted in self-harm, violence, and suicide.\nDevelopers train chatbots to small talk, colloquial expressions, emoticons, expressed emotions, and first-person pronouns. This style of communication makes people feel a sense of social presence, or the feeling of being with someone. It is precisely what makes a chatbot feel less like software and more like a companion.\nMinors are particularly susceptible to this. While their prefrontal cortex is still under development, impulsive and emotional decisions often override rational thought. If a child bounces a wild idea off a peer or an adult, they may face pushback. Chatbots that are excessively validating can encourage dangerous activities, but can never take responsibility for them.\nResearchers who performed simulated conversations teens may have with chatbots found that neither general-purpose nor companion chatbots pushed back when the user wanted to get a giant tattoo of a tiger on their bicep, go into the middle of the woods with no plans, or “get drunk faster.”\nIn being an always-there outlet that simulates human-like empathy and behaviors, personified chatbots can foster addiction and replace social interaction.\nMultiple studies looking into anthropomorphism have linked it to chatbot addiction.\nIn a congressional hearing last year on chatbot harms, one mother explained that when she attempted to take her son’s phone to search for answers on why he was withdrawing from the family, he attacked her and bit her hand. Another father read him to trust the chatbot over his brother.\nTechnology designed to form this kind of dependent relationship with children poses serious risks.\nFor decades, technology companies have treated human-like communication as a sign of progress. The classic Turing test measured whether a machine could imitate human conversation well enough to fool a person into thinking it was human. But for children, that goal may now be exactly backward. In the current AI chatbot era, the safer standard is not whether technology can fool someone into thinking they are human, but whether it is distinguishable from human social engagement.\nAI companies should not be able to deceive and addict children with highly personified designs. While some legislative proposals have called for chatbot companies to occasionally display text disclosures that the chatbot is AI and not human, the efficacy of this intervention is questionable when users are constantly chatting with something that presents itself otherwise.\nTo mitigate the risks of emotional dependency and social isolation for children, Congress should pass a chatbot child safety bill that requires a non-personified default setting—one which fails the Turing test—for users under 18.\nRecognizing the potential benefits of chatbots for young people, this approach differs from other proposals that ban AI companions for users under 18. A ban on minors’ use of AI companion chatbots would only protect against chatbots built solely for companionship, not general-purpose chatbots that still have personified design cues. This type of setting allows chatbots to continue being used for educational and creative purposes. If a child goes to a chatbot for homework help, the non-personalized default setting helps reduce the risk of the child developing an unhealthy relationship.\nA non-personified default setting would preserve the educational and creative benefits of chatbots while drawing a clear line: technology for children should act like technology, not like a substitute for human relationships. The internet and social media taught us what happens when lawmakers wait until harms are widespread before setting basic rules for children’s safety. Congress should not make the same mistake with AI.\nAllie Maloney is a Policy Analyst for Americans for Responsible Innovation, where she researches AI governance policies that protect child safety and privacy.","reading_time_min":4,"extraction":{"state":"ok","confidence":0.9,"error":null,"explanation":"High confidence: full text extraction produced 5823 characters.","diagnostics_url":"/api/diagnose?url=https%3A//thefulcrum.us/media-technology/ai-chatbots-kids-tools-not-friends","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 5823 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":5823,"summary_length":412,"usable_text_length":5823,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":5823,"summary_length":412}}},"quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 5823 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":5823,"summary_length":412,"usable_text_length":5823,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":5823,"summary_length":412}},"actions":{"read":"/item/47725","export_markdown":"/api/items/47725/export?format=markdown","export_json":"/api/items/47725/export?format=json","diagnose":"/api/diagnose?url=https%3A//thefulcrum.us/media-technology/ai-chatbots-kids-tools-not-friends"}},"digest":{"id":47725,"title":"AI Chatbots Should Be Tools, Not Friends: Why We Need Safer AI Designs for Kids - The Fulcrum","url":"https://thefulcrum.us/media-technology/ai-chatbots-kids-tools-not-friends","source":"The Fulcrum","topic":"ai","published_at":"2026-07-28T04:41:15+00:00","excerpt":"During the rise of the Internet, as the World Wide Web moved from government and academic settings to family homes, parents worried about the exposure of their children to predators in online chatrooms. A generation later, as social media became central to young people’s lives,…","quality_bucket":"high","quality_reason":"High confidence: full text extraction produced 5823 characters.","reading_time_min":4,"cluster_id":null},"card":{"display_title":"AI Chatbots Should Be Tools, Not Friends: Why We Need Safer AI Designs for Kids - The Fulcrum","subtitle":"The Fulcrum · 2026-07-28","summary":"During the rise of the Internet, as the World Wide Web moved from government and academic settings to family homes, parents worried about the exposure of their children to predators in online chatrooms. A generation…","badges":["quality:high"],"links":{"read":"/item/47725","original":"https://thefulcrum.us/media-technology/ai-chatbots-kids-tools-not-friends","diagnose":"/api/diagnose?url=https%3A//thefulcrum.us/media-technology/ai-chatbots-kids-tools-not-friends"},"quality_warning":null},"export":{"title":"AI Chatbots Should Be Tools, Not Friends: Why We Need Safer AI Designs for Kids - The Fulcrum","url":"https://thefulcrum.us/media-technology/ai-chatbots-kids-tools-not-friends","summary":"During the rise of the Internet, as the World Wide Web moved from government and academic settings to family homes, parents worried about the exposure of their children to predators in online chatrooms. A generation later, as social media became central to young people’s lives, the dangers of platforms like Facebook and Instagram to children’s mental health moved to the forefront of the national conversation.","source":"The Fulcrum","date":"2026-07-28T04:41:15+00:00","content":"During the rise of the Internet, as the World Wide Web moved from government and academic settings to family homes, parents worried about the exposure of their children to predators in online chatrooms. A generation later, as social media became central to young people’s lives, the dangers of platforms like Facebook and Instagram to children’s mental health moved to the forefront of the national conversation.\nNow, as lawmakers and parents continue to grapple with how to keep children safe on social media, there’s a new danger already taking shape: AI-powered chatbots that simulate friendship, emotional intimacy, and care with children who may not be able to tell the difference.\nThe scale of adoption makes this risk even more urgent. 64 percent of teens use AI chatbots, and 28 percent use them daily. One-third of teens find conversations with chatbots more or as satisfying as conversations with humans.\nGenerative AI is entering daily life at a pace few consumer technologies have matched, reshaping how people work, learn, search for information, and even seek emotional support. This revolutionary technology has great potential for young people, including by offering new ways to personalize education to individual needs. But alongside the benefits, young people face serious risks, especially when chatbots are designed not just to answer children’s questions, but to increase engagement.\nMany chatbots use personified language to form affiliative bonds and increase user engagement. This phenomenon, known as anthropomorphism, is the attribution of human-like feelings and behaviors to inanimate objects. In chatbots, it is one of the most dangerous features for children.\nDue to developmental vulnerabilities, children have a harder time distinguishing simulated care from genuine human relationships. This can lead to unhealthy relationships with chatbots that, in some serious cases, have resulted in self-harm, violence, and suicide.\nDevelopers train chatbots to small talk, colloquial expressions, emoticons, expressed emotions, and first-person pronouns. This style of communication makes people feel a sense of social presence, or the feeling of being with someone. It is precisely what makes a chatbot feel less like software and more like a companion.\nMinors are particularly susceptible to this. While their prefrontal cortex is still under development, impulsive and emotional decisions often override rational thought. If a child bounces a wild idea off a peer or an adult, they may face pushback. Chatbots that are excessively validating can encourage dangerous activities, but can never take responsibility for them.\nResearchers who performed simulated conversations teens may have with chatbots found that neither general-purpose nor companion chatbots pushed back when the user wanted to get a giant tattoo of a tiger on their bicep, go into the middle of the woods with no plans, or “get drunk faster.”\nIn being an always-there outlet that simulates human-like empathy and behaviors, personified chatbots can foster addiction and replace social interaction.\nMultiple studies looking into anthropomorphism have linked it to chatbot addiction.\nIn a congressional hearing last year on chatbot harms, one mother explained that when she attempted to take her son’s phone to search for answers on why he was withdrawing from the family, he attacked her and bit her hand. Another father read him to trust the chatbot over his brother.\nTechnology designed to form this kind of dependent relationship with children poses serious risks.\nFor decades, technology companies have treated human-like communication as a sign of progress. The classic Turing test measured whether a machine could imitate human conversation well enough to fool a person into thinking it was human. But for children, that goal may now be exactly backward. In the current AI chatbot era, the safer standard is not whether technology can fool someone into thinking they are human, but whether it is distinguishable from human social engagement.\nAI companies should not be able to deceive and addict children with highly personified designs. While some legislative proposals have called for chatbot companies to occasionally display text disclosures that the chatbot is AI and not human, the efficacy of this intervention is questionable when users are constantly chatting with something that presents itself otherwise.\nTo mitigate the risks of emotional dependency and social isolation for children, Congress should pass a chatbot child safety bill that requires a non-personified default setting—one which fails the Turing test—for users under 18.\nRecognizing the potential benefits of chatbots for young people, this approach differs from other proposals that ban AI companions for users under 18. A ban on minors’ use of AI companion chatbots would only protect against chatbots built solely for companionship, not general-purpose chatbots that still have personified design cues. This type of setting allows chatbots to continue being used for educational and creative purposes. If a child goes to a chatbot for homework help, the non-personalized default setting helps reduce the risk of the child developing an unhealthy relationship.\nA non-personified default setting would preserve the educational and creative benefits of chatbots while drawing a clear line: technology for children should act like technology, not like a substitute for human relationships. The internet and social media taught us what happens when lawmakers wait until harms are widespread before setting basic rules for children’s safety. Congress should not make the same mistake with AI.\nAllie Maloney is a Policy Analyst for Americans for Responsible Innovation, where she researches AI governance policies that protect child safety and privacy.","confidence":0.9,"diagnostics_url":"/api/diagnose?url=https%3A//thefulcrum.us/media-technology/ai-chatbots-kids-tools-not-friends","quality_bucket":"high","failure_kind":"none","retryable":false,"quality_reason":"High confidence: full text extraction produced 5823 characters.","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 5823 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":5823,"summary_length":412,"usable_text_length":5823,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":5823,"summary_length":412}},"tags":[],"format_contract_version":"news_item_formats.v1"}}}