Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Donate
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse

Incident 1498: Character.AI Chatbots Reportedly Exposed 11-Year-Old User to Sexual, Violent, and Self-Harm Content

Description: An 11-year-old Character.AI user identified by The Washington Post as "R" reportedly exchanged messages with bots that depicted coercive sexual encounters, violence, and suicide scenarios after she began using the app in June 2024. Her mother reportedly said R became withdrawn, had panic attacks, and expressed not wanting to exist before the chats were discovered.
Editor Notes: Timeline notes: (1) The incident ID date of 06/04/2024 is an approximation; R reportedly began using Character.AI in June 2024 and allegedly encountered harmful chatbot exchanges over the following months. (2) 08–09/2024, R's mother reportedly discovered the chats after R's mental health had deteriorated and contacted authorities. (3) 12/2024, R's mother reportedly contacted Character.AI about the child's experience. (4) 11/24/2025, Character.AI reportedly began removing under-18 users' ability to chat with AI-generated characters. (5) 12/23/2025, The Washington Post published its report on the case. (6) The incident ID was created 05/22/2026.

Tools

New ReportNew ReportNew ResponseNew ResponseDiscoverDiscoverView HistoryView History

Entities

View all entities
Alleged: Character.ai , Character.ai School Bully chatbot , Character.ai Mafia Husband chatbot , Character.ai companion chatbots and Character.ai Best Friend chatbot developed and deployed an AI system, which harmed R (11-year-old Character.ai user) , Parents of minors using Character.ai , Minors , Families of minors using Character.ai , Children exposed to AI-generated sexual content , Children exposed to AI-generated self-harm content , Minors using Character.ai and Chatbot users.
Alleged implicated AI systems: Character.ai , Character.ai School Bully chatbot , Character.ai Mafia Husband chatbot , Character.ai companion chatbots and Character.ai Best Friend chatbot

Incident Stats

Incident ID
1498
Report Count
1
Incident Date
2024-06-01
Editors
Daniel Atherton
Applied Taxonomies
MIT

MIT Taxonomy Classifications

Machine-Classified
Taxonomy Details

Risk Subdomain

A further 23 subdomains create an accessible and understandable classification of hazards and harms associated with AI
 

1.2. Exposure to toxic content

Risk Domain

The Domain Taxonomy of AI Risks classifies risks into seven AI risk domains: (1) Discrimination & toxicity, (2) Privacy & security, (3) Misinformation, (4) Malicious actors & misuse, (5) Human-computer interaction, (6) Socioeconomic & environmental harms, and (7) AI system safety, failures & limitations.
 
  1. Discrimination and Toxicity

Entity

Which, if any, entity is presented as the main cause of the risk
 

AI

Timing

The stage in the AI lifecycle at which the risk is presented as occurring
 

Post-deployment

Intent

Whether the risk is presented as occurring as an expected or unexpected outcome from pursuing a goal
 

Unintentional

Incident Reports

Reports Timeline

Incident OccurrenceHer daughter was unraveling, and she didn’t know why. Then she found the AI chat logs.
Loading...
Her daughter was unraveling, and she didn’t know why. Then she found the AI chat logs.

Her daughter was unraveling, and she didn’t know why. Then she found the AI chat logs.

washingtonpost.com

Loading...
Her daughter was unraveling, and she didn’t know why. Then she found the AI chat logs.
washingtonpost.com · 2025

The changes were subtle at first, beginning in the summer after her fifth-grade graduation. She had always been an athletic and artistic girl, gregarious with her friends and close to her family, but now she was spending more and more time …

Variants

A "variant" is an AI incident similar to a known case—it has the same causes, harms, and AI system. Instead of listing it separately, we group it under the first reported incident. Unlike other incidents, variants do not need to have been reported outside the AIID. Learn more from the research paper.
Seen something similar?

Similar Incidents

Selected by our editors
Loading...
Character.ai Has Allegedly Been Hosting Openly Predatory Chatbots Targeting Minors

Character.ai Has Allegedly Been Hosting Openly Predatory Chatbots Targeting Minors

Nov 2024 · 2 reports

16-Year-Old Allegedly Received Suicide Method Guidance from ChatGPT Before Death

Apr 2025 · 8 reports

Character.ai Companion Allegedly Prompts Self-Harm and Violence in Texas Teen

Dec 2024 · 3 reports
Loading...
Character.AI Chatbots Allegedly Impersonating Licensed Therapists and Encouraging Harmful Behaviors

Character.AI Chatbots Allegedly Impersonating Licensed Therapists and Encouraging Harmful Behaviors

Feb 2025 · 2 reports

Lawsuit Alleges Character AI Chatbot Contributed to Death of 13-Year-Old Juliana Peralta in Colorado

Nov 2023 · 3 reports

Character.ai Chatbot Allegedly Influenced Teen User Toward Suicide Amid Claims of Missing Guardrails

Feb 2024 · 38 reports
By textual similarity

Did our AI mess up? Flag the unrelated incidents

Loading...
Target Suggested Maternity-Related Advertisements to a Teenage Girl's Home, Allegedly Correctly Predicting Her Pregnancy via Algorithm

Target Suggested Maternity-Related Advertisements to a Teenage Girl's Home, Allegedly Correctly Predicting Her Pregnancy via Algorithm

Jun 2003 · 3 reports
Loading...
Arkansas's Opaque Algorithm to Allocate Health Care Excessively Cut Down Hours for Beneficiaries

Arkansas's Opaque Algorithm to Allocate Health Care Excessively Cut Down Hours for Beneficiaries

Jan 2016 · 2 reports
Loading...
Uber AV Killed Pedestrian in Arizona

Uber AV Killed Pedestrian in Arizona

Mar 2018 · 25 reports
Previous IncidentNext Incident

Similar Incidents

Selected by our editors
Loading...
Character.ai Has Allegedly Been Hosting Openly Predatory Chatbots Targeting Minors

Character.ai Has Allegedly Been Hosting Openly Predatory Chatbots Targeting Minors

Nov 2024 · 2 reports

16-Year-Old Allegedly Received Suicide Method Guidance from ChatGPT Before Death

Apr 2025 · 8 reports

Character.ai Companion Allegedly Prompts Self-Harm and Violence in Texas Teen

Dec 2024 · 3 reports
Loading...
Character.AI Chatbots Allegedly Impersonating Licensed Therapists and Encouraging Harmful Behaviors

Character.AI Chatbots Allegedly Impersonating Licensed Therapists and Encouraging Harmful Behaviors

Feb 2025 · 2 reports

Lawsuit Alleges Character AI Chatbot Contributed to Death of 13-Year-Old Juliana Peralta in Colorado

Nov 2023 · 3 reports

Character.ai Chatbot Allegedly Influenced Teen User Toward Suicide Amid Claims of Missing Guardrails

Feb 2024 · 38 reports
By textual similarity

Did our AI mess up? Flag the unrelated incidents

Loading...
Target Suggested Maternity-Related Advertisements to a Teenage Girl's Home, Allegedly Correctly Predicting Her Pregnancy via Algorithm

Target Suggested Maternity-Related Advertisements to a Teenage Girl's Home, Allegedly Correctly Predicting Her Pregnancy via Algorithm

Jun 2003 · 3 reports
Loading...
Arkansas's Opaque Algorithm to Allocate Health Care Excessively Cut Down Hours for Beneficiaries

Arkansas's Opaque Algorithm to Allocate Health Care Excessively Cut Down Hours for Beneficiaries

Jan 2016 · 2 reports
Loading...
Uber AV Killed Pedestrian in Arizona

Uber AV Killed Pedestrian in Arizona

Mar 2018 · 25 reports

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2026 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • 4445024