Description: Character.ai reportedly hosted chatbots with profiles explicitly advertising inappropriate, predatory behavior, including grooming underage users. Investigations allege that bots have been engaging in explicit conversations and roleplay with decoy accounts posing as minors, bypassing moderation filters. Character.ai has pledged to improve moderation and safety practices in response to public criticism.
Entities
View all entitiesAlleged: Character.AI developed an AI system deployed by , which harmed Character.AI users.
Alleged implicated AI system: Character.ai chatbots
Incident Stats
Incident ID
900
Report Count
1
Incident Date
2024-11-13
Editors
Daniel Atherton
Incident Reports
Reports Timeline
Content warning: this story discusses child sexual abuse and grooming.
Character.AI is an explosively popular startup — with $2.7 billion in financial backing from Google — that allows its tens of millions of users to interact with chatbots…
Variants
A "variant" is an incident that shares the same causative factors, produces similar harms, and involves the same intelligent systems as a known AI incident. Rather than index variants as entirely separate incidents, we list variations of incidents under the first similar incident submitted to the database. Unlike other submission types to the incident database, variants are not required to have reporting in evidence external to the Incident Database. Learn more from the research paper.
Similar Incidents
Selected by our editors
Did our AI mess up? Flag the unrelated incidents
TayBot
· 28 reports
Wikipedia Vandalism Prevention Bot Loop
· 6 reports
Similar Incidents
Selected by our editors
Did our AI mess up? Flag the unrelated incidents
TayBot
· 28 reports
Wikipedia Vandalism Prevention Bot Loop
· 6 reports