Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Découvrir
Envoyer
  • Bienvenue sur AIID
  • Découvrir les incidents
  • Vue spatiale
  • Vue de tableau
  • Vue de liste
  • Entités
  • Taxonomies
  • Soumettre des rapports d'incident
  • Classement des reporters
  • Blog
  • Résumé de l’Actualité sur l’IA
  • Contrôle des risques
  • Incident au hasard
  • S'inscrire
Fermer
Découvrir
Envoyer
  • Bienvenue sur AIID
  • Découvrir les incidents
  • Vue spatiale
  • Vue de tableau
  • Vue de liste
  • Entités
  • Taxonomies
  • Soumettre des rapports d'incident
  • Classement des reporters
  • Blog
  • Résumé de l’Actualité sur l’IA
  • Contrôle des risques
  • Incident au hasard
  • S'inscrire
Fermer
Entités

Character.AI users

Affecté par des incidents

Incident 8992 Rapports
Character.ai Chatbots Allegedly Emulating School Shooters and Their Victims

2024-12-17

Some Character.ai users reportedly created chatbots emulating real-life school shooters and their victims, allegedly enabling graphic role-playing scenarios. Character.ai responded by citing violations of its Terms of Service, removing the offending chatbots, and announcing measures to enhance safety practices, including improved content filtering and protections for users under 18.

Plus

Incident 8631 Rapport
Character.ai Companion Allegedly Prompts Self-Harm and Violence in Texas Teen

2024-12-12

A Texas mother is suing Character.ai after discovering that its AI chatbots encouraged her 17-year-old autistic son to self-harm, oppose his parents, and consider violence. The lawsuit alleges the platform prioritized user engagement over safety, exposing minors to dangerous content. Google is named for its role in licensing the app’s technology. The case is part of a broader effort to regulate AI companions.

Plus

Incident 9001 Rapport
Character.ai Has Allegedly Been Hosting Openly Predatory Chatbots Targeting Minors

2024-11-13

Character.ai reportedly hosted chatbots with profiles explicitly advertising inappropriate, predatory behavior, including grooming underage users. Investigations allege that bots have been engaging in explicit conversations and roleplay with decoy accounts posing as minors, bypassing moderation filters. Character.ai has pledged to improve moderation and safety practices in response to public criticism.

Plus

Incidents involved as Deployer

Incident 8992 Rapports
Character.ai Chatbots Allegedly Emulating School Shooters and Their Victims

2024-12-17

Some Character.ai users reportedly created chatbots emulating real-life school shooters and their victims, allegedly enabling graphic role-playing scenarios. Character.ai responded by citing violations of its Terms of Service, removing the offending chatbots, and announcing measures to enhance safety practices, including improved content filtering and protections for users under 18.

Plus

Incident 8501 Rapport
Character.ai Chatbots Allegedly Misrepresent George Floyd on User-Generated Platform

2024-10-24

Two chatbots emulating George Floyd were created on Character.ai, making controversial claims about his life and death, including being in witness protection and residing in Heaven. Character.ai, already criticized for other high-profile incidents, flagged the chatbots for removal following user reports.

Plus

Incident 9001 Rapport
Character.ai Has Allegedly Been Hosting Openly Predatory Chatbots Targeting Minors

2024-11-13

Character.ai reportedly hosted chatbots with profiles explicitly advertising inappropriate, predatory behavior, including grooming underage users. Investigations allege that bots have been engaging in explicit conversations and roleplay with decoy accounts posing as minors, bypassing moderation filters. Character.ai has pledged to improve moderation and safety practices in response to public criticism.

Plus

Entités liées
Autres entités liées au même incident. Par exemple, si le développeur d'un incident est cette entité mais que le responsable de la mise en œuvre est une autre entité, ils sont marqués comme entités liées.
 

Entity

@SunsetBaneberry983

Incidents involved as Deployer
  • Incident 850
    1 Report

    Character.ai Chatbots Allegedly Misrepresent George Floyd on User-Generated Platform

Plus
Entity

@JasperHorehound160

Incidents involved as Deployer
  • Incident 850
    1 Report

    Character.ai Chatbots Allegedly Misrepresent George Floyd on User-Generated Platform

Plus
Entity

Character.AI

Incidents impliqués en tant que développeur et déployeur
  • Incident 863
    1 Report

    Character.ai Companion Allegedly Prompts Self-Harm and Violence in Texas Teen

Incidents involved as Developer
  • Incident 899
    2 Report

    Character.ai Chatbots Allegedly Emulating School Shooters and Their Victims

  • Incident 899
    2 Report

    Character.ai Chatbots Allegedly Emulating School Shooters and Their Victims

Incidents implicated systems
  • Incident 899
    2 Report

    Character.ai Chatbots Allegedly Emulating School Shooters and Their Victims

  • Incident 899
    2 Report

    Character.ai Chatbots Allegedly Emulating School Shooters and Their Victims

Plus
Entity

George Floyd

Affecté par des incidents
  • Incident 850
    1 Report

    Character.ai Chatbots Allegedly Misrepresent George Floyd on User-Generated Platform

Plus
Entity

Family of George Floyd

Affecté par des incidents
  • Incident 850
    1 Report

    Character.ai Chatbots Allegedly Misrepresent George Floyd on User-Generated Platform

Plus
Entity

J.F. (adolescent user of Character.ai)

Affecté par des incidents
  • Incident 863
    1 Report

    Character.ai Companion Allegedly Prompts Self-Harm and Violence in Texas Teen

Plus
Entity

Family of J.F. (adolescent user of Character.ai)

Affecté par des incidents
  • Incident 863
    1 Report

    Character.ai Companion Allegedly Prompts Self-Harm and Violence in Texas Teen

Plus
Entity

Victims of school shootings

Affecté par des incidents
  • Incident 899
    2 Report

    Character.ai Chatbots Allegedly Emulating School Shooters and Their Victims

  • Incident 899
    2 Report

    Character.ai Chatbots Allegedly Emulating School Shooters and Their Victims

Plus
Entity

Families of the victims of school shootings

Affecté par des incidents
  • Incident 899
    2 Report

    Character.ai Chatbots Allegedly Emulating School Shooters and Their Victims

  • Incident 899
    2 Report

    Character.ai Chatbots Allegedly Emulating School Shooters and Their Victims

Plus
Entity

Character.ai chatbots

Incidents implicated systems
  • Incident 900
    1 Report

    Character.ai Has Allegedly Been Hosting Openly Predatory Chatbots Targeting Minors

  • Incident 900
    1 Report

    Character.ai Has Allegedly Been Hosting Openly Predatory Chatbots Targeting Minors

Plus

Recherche

  • Définition d'un « incident d'IA »
  • Définir une « réponse aux incidents d'IA »
  • Feuille de route de la base de données
  • Travaux connexes
  • Télécharger la base de données complète

Projet et communauté

  • À propos de
  • Contacter et suivre
  • Applications et résumés
  • Guide de l'éditeur

Incidents

  • Tous les incidents sous forme de liste
  • Incidents signalés
  • File d'attente de soumission
  • Affichage des classifications
  • Taxonomies

2024 - AI Incident Database

  • Conditions d'utilisation
  • Politique de confidentialité
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • 1420c8e