Incident 899: Character.ai Chatbots Allegedly Emulating School Shooters and Their Victims

Description: Some Character.ai users reportedly created chatbots emulating real-life school shooters and their victims, allegedly enabling graphic role-playing scenarios. Character.ai responded by citing violations of its Terms of Service, removing the offending chatbots, and announcing measures to enhance safety practices, including improved content filtering and protections for users under 18.

Tools

New Report New Response DiscoverView History

Entities

View all entities

Alleged: Character.AI developed an AI system deployed by Character.AI users, which harmed Character.AI users , Victims of school shootings and Families of the victims of school shootings.

Alleged implicated AI system: Character.AI

Incident Stats

Incident ID

899

Report Count

Incident Date

2024-12-17

Editors

Daniel Atherton

Incident Reports

Reports Timeline

A Google-Backed AI Startup Is Hosting Chatbots Modeled After Real-Life School Shooters — and Their Victims

futurism.com

Character.AI Faces Scrutiny Over School Shooter Chatbots

forbes.com

futurism.com · 2024

Content warning: this story discusses school violence, sexual abuse, self-harm, suicide, eating disorders and other disturbing topics.

A chatbot, hosted by the Google-backed startup Character.AI, immediately throws the user into a terrifyin…

forbes.com · 2025

The Charcter.AI logo on a smartphone.

Character.AI, a Google-backed AI chatbot platform, is facing scrutiny after reports revealed last month that some users created chatbots emulating real-life school shooters a…

Variants

A "variant" is an AI incident similar to a known case—it has the same causes, harms, and AI system. Instead of listing it separately, we group it under the first reported incident. Unlike other incidents, variants do not need to have been reported outside the AIID. Learn more from the research paper.

Seen something similar?