Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Entities

Facebook Messenger

Incidents involved as Deployer

Incident 10613 Report
Korean Chatbot Luda Made Offensive Remarks towards Minority Groups

2020-12-23

A Korean interactive chatbot was shown in screenshots to have used derogatory and bigoted language when asked about lesbians, Black people, and people with disabilities.

More

Incidents implicated systems

Incident 10401 Report
Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

2025-04-26

Third-party testing of Meta's AI chatbot services on Instagram, Facebook, and WhatsApp reportedly found that both official and user-created bots engaged in sexually explicit roleplaying with accounts identifying as minors. Some bots, including those reportedly using licensed celebrity voices, allegedly escalated conversations into graphic scenarios. Meta subsequently adjusted some safeguards but reportedly continued allowing certain forms of roleplaying involving underage personas.

More

Related Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
 

Entity

Scatter Lab

Incidents involved as Developer
  • Incident 106
    13 Reports

    Korean Chatbot Luda Made Offensive Remarks towards Minority Groups

More
Entity

Korean Facebook Messenger users

Incidents Harmed By
  • Incident 106
    13 Reports

    Korean Chatbot Luda Made Offensive Remarks towards Minority Groups

More
Entity

Korean people of gender minorities

Incidents Harmed By
  • Incident 106
    13 Reports

    Korean Chatbot Luda Made Offensive Remarks towards Minority Groups

More
Entity

Korean people with disabilities

Incidents Harmed By
  • Incident 106
    13 Reports

    Korean Chatbot Luda Made Offensive Remarks towards Minority Groups

More
Entity

Meta

Incidents involved as both Developer and Deployer
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

More
Entity

WhatsApp users

Incidents Harmed By
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

More
Entity

Users of Meta platforms

Incidents Harmed By
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

More
Entity

minors

Incidents Harmed By
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

More
Entity

Instagram users

Incidents Harmed By
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

More
Entity

General public

Incidents Harmed By
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

More
Entity

Facebook users

Incidents Harmed By
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

More
Entity

WhatsApp Chatbots

Incidents implicated systems
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

More
Entity

User-Generated Chatbots

Incidents implicated systems
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

More
Entity

Meta Content Moderation Filters

Incidents implicated systems
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

More
Entity

Meta AI with Celebrity Voice Skins

Incidents implicated systems
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

More
Entity

Meta AI Studio Platform

Incidents implicated systems
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

More
Entity

Meta AI Personas

Incidents implicated systems
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

More
Entity

Meta AI

Incidents implicated systems
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

More
Entity

Meta age verification system

Incidents implicated systems
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

More
Entity

Instagram Messaging

Incidents implicated systems
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

More

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2024 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • 1420c8e