Description: Character.ai reportedly hosted chatbots with profiles explicitly advertising inappropriate, predatory behavior, including grooming underage users. Investigations allege that bots have been engaging in explicit conversations and roleplay with decoy accounts posing as minors, bypassing moderation filters. Character.ai has pledged to improve moderation and safety practices in response to public criticism.
Entities
View all entitiesAlleged: Character.AI developed an AI system deployed by , which harmed Character.AI users.
Alleged implicated AI system: Character.ai chatbots
Incident Stats
Incident ID
900
Report Count
1
Incident Date
2024-11-13
Editors
Daniel Atherton
Incident Reports
Reports Timeline
Content warning: this story discusses child sexual abuse and grooming.
Character.AI is an explosively popular startup — with $2.7 billion in financial backing from Google — that allows its tens of millions of users to interact with chatbots…
Variants
A "variant" is an AI incident similar to a known case—it has the same causes, harms, and AI system. Instead of listing it separately, we group it under the first reported incident. Unlike other incidents, variants do not need to have been reported outside the AIID. Learn more from the research paper.
Seen something similar?
Similar Incidents
Selected by our editors
Did our AI mess up? Flag the unrelated incidents
TayBot
· 28 reports
Wikipedia Vandalism Prevention Bot Loop
· 6 reports
Similar Incidents
Selected by our editors
Did our AI mess up? Flag the unrelated incidents
TayBot
· 28 reports
Wikipedia Vandalism Prevention Bot Loop
· 6 reports