Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Entities

minors

Incidents Harmed By

Incident 95811 Report
Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material

2025-02-26

Europol’s Operation Cumberland uncovered a global network distributing AI-generated child sexual abuse material (CSAM). The operation has led to 25 arrests and 273 identified suspects across 19 countries. The AI-enabled abuse allows criminals to create exploitative content at scale with minimal expertise.

More

Incident 6894 Report
Holmen, Wisconsin Man Allegedly Used Stable Diffusion to Create and Then Share Sexually Explicit Images Depicting Minors

2024-03-26

The FBI has arrested Steven Anderegg of Holmen, Wisconsin for having allegedly used Stable Diffusion to generate about 13,000 sexually explicit images of minors, which he then is also alleged to have shared and distributed, including with at least one minor, via Telegram and Instagram. Anderegg was originally apprehended by state police in March, and this case marks one of the first times the FBI has brought charges against someone for having used AI to generate CSAM.

More

Incident 10102 Report
GenNomis AI Database Reportedly Exposes Nearly 100,000 Deepfake and Nudify Images in Public Breach

2025-03-31

In March 2025, cybersecurity researcher Jeremiah Fowler discovered an unprotected database linked to GenNomis by AI-NOMIS, a South Korean company offering face-swapping and "nudify" AI services. The exposed 47.8GB dataset included nearly 100,000 files. Many depicted explicit deepfake images, some involving minors or celebrities. No personal data was found, but the breach was a serious failure in data security and consent safeguards in AI image-generation platforms.

More

Incident 4911 Report
Replika's AI Experience Reportedly Lacked Protection for Minors, Resulting in Data Ban

2023-02-02

Tests by the Italian Data Protection Authority showed Replika lacking age-verification mechanisms and failing to stop minors from interacting with its AI, which prompted the agency to issue an order blocking personal data processing of Italian users.

More

Related Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
 

Entity

Replika

Incidents involved as both Developer and Deployer
  • Incident 491
    1 Report

    Replika's AI Experience Reportedly Lacked Protection for Minors, Resulting in Data Ban

More
Entity

Snapchat

Incidents involved as both Developer and Deployer
  • Incident 539
    1 Report

    Snapchat's My AI Reported for Lacking Protection for Children

  • Incident 646
    1 Report

    Snapchat's Algorithm Alleged to Link Minor with Sex Offenders

More
Entity

OpenAI

Incidents involved as Developer
  • Incident 539
    1 Report

    Snapchat's My AI Reported for Lacking Protection for Children

More
Entity

Meta

Incidents involved as both Developer and Deployer
  • Incident 583
    1 Report

    Instagram Algorithms Allegedly Promote Accounts Facilitating Child Sex Abuse Content

  • Incident 957
    1 Report

    Alleged Instagram Algorithm Malfunction Floods Users’ Reels Feeds with Violent and Graphic Content

More
Entity

Instagram

Incidents involved as both Developer and Deployer
  • Incident 583
    1 Report

    Instagram Algorithms Allegedly Promote Accounts Facilitating Child Sex Abuse Content

  • Incident 788
    1 Report

    Instagram's Algorithm Reportedly Recommended Sexual Content to Teenagers' Accounts

More
Entity

Children

Incidents Harmed By
  • Incident 958
    11 Reports

    Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material

  • Incident 583
    1 Report

    Instagram Algorithms Allegedly Promote Accounts Facilitating Child Sex Abuse Content

More
Entity

General public

Incidents Harmed By
  • Incident 689
    4 Reports

    Holmen, Wisconsin Man Allegedly Used Stable Diffusion to Create and Then Share Sexually Explicit Images Depicting Minors

  • Incident 1010
    2 Reports

    GenNomis AI Database Reportedly Exposes Nearly 100,000 Deepfake and Nudify Images in Public Breach

More
Entity

teenagers

Incidents Harmed By
  • Incident 583
    1 Report

    Instagram Algorithms Allegedly Promote Accounts Facilitating Child Sex Abuse Content

More
Entity

Microsoft

Incidents involved as both Developer and Deployer
  • Incident 654
    1 Report

    Microsoft Copilot Designer Reportedly Generated Inappropriate AI Images

More
Entity

Steven Anderegg

Incidents involved as Deployer
  • Incident 689
    4 Reports

    Holmen, Wisconsin Man Allegedly Used Stable Diffusion to Create and Then Share Sexually Explicit Images Depicting Minors

More
Entity

Stable Diffusion

Incidents involved as Developer
  • Incident 689
    4 Reports

    Holmen, Wisconsin Man Allegedly Used Stable Diffusion to Create and Then Share Sexually Explicit Images Depicting Minors

More
Entity

Stability AI

Incidents involved as Developer
  • Incident 689
    4 Reports

    Holmen, Wisconsin Man Allegedly Used Stable Diffusion to Create and Then Share Sexually Explicit Images Depicting Minors

More
Entity

Meta Platforms

Incidents involved as both Developer and Deployer
  • Incident 788
    1 Report

    Instagram's Algorithm Reportedly Recommended Sexual Content to Teenagers' Accounts

More
Entity

Instagram users

Incidents Harmed By
  • Incident 788
    1 Report

    Instagram's Algorithm Reportedly Recommended Sexual Content to Teenagers' Accounts

  • Incident 957
    1 Report

    Alleged Instagram Algorithm Malfunction Floods Users’ Reels Feeds with Violent and Graphic Content

More
Entity

Meta users

Incidents Harmed By
  • Incident 957
    1 Report

    Alleged Instagram Algorithm Malfunction Floods Users’ Reels Feeds with Violent and Graphic Content

More
Entity

Instagram recommendation algorithm

Incidents implicated systems
  • Incident 957
    1 Report

    Alleged Instagram Algorithm Malfunction Floods Users’ Reels Feeds with Violent and Graphic Content

More
Entity

Instagram Reels

Incidents implicated systems
  • Incident 957
    1 Report

    Alleged Instagram Algorithm Malfunction Floods Users’ Reels Feeds with Violent and Graphic Content

More
Entity

Suspects identified in Operation Cumberland

Incidents involved as Deployer
  • Incident 958
    11 Reports

    Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material

More
Entity

CSAM distributors

Incidents involved as Deployer
  • Incident 958
    11 Reports

    Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material

More
Entity

Unknown deepfake technology developer

Incidents involved as Developer
  • Incident 958
    11 Reports

    Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material

  • Incident 1006
    1 Report

    Edinburg, Texas Police Officer Arrested for Alleged Possession of CSAM, Including AI-Generated Deepfakes of Minors

More
Entity

Unknown deepfake CSAM tools

Incidents involved as Developer
  • Incident 958
    11 Reports

    Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material

More
Entity

Potential victims of exploitation

Incidents Harmed By
  • Incident 958
    11 Reports

    Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material

More
Entity

Unknown deepfake apps

Incidents implicated systems
  • Incident 958
    11 Reports

    Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material

More
Entity

Unknown CSAM apps

Incidents implicated systems
  • Incident 958
    11 Reports

    Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material

More
Entity

Dark web marketplaces

Incidents implicated systems
  • Incident 958
    11 Reports

    Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material

More
Entity

Preston Wade Pietrzykowski

Incidents involved as Deployer
  • Incident 1006
    1 Report

    Edinburg, Texas Police Officer Arrested for Alleged Possession of CSAM, Including AI-Generated Deepfakes of Minors

More
Entity

General public of Texas

Incidents Harmed By
  • Incident 1006
    1 Report

    Edinburg, Texas Police Officer Arrested for Alleged Possession of CSAM, Including AI-Generated Deepfakes of Minors

More
Entity

Texas Department of Public Safety

Incidents Harmed By
  • Incident 1006
    1 Report

    Edinburg, Texas Police Officer Arrested for Alleged Possession of CSAM, Including AI-Generated Deepfakes of Minors

More
Entity

Unknown deepfake app

Incidents implicated systems
  • Incident 1006
    1 Report

    Edinburg, Texas Police Officer Arrested for Alleged Possession of CSAM, Including AI-Generated Deepfakes of Minors

More
Entity

GenNomis by AI-NOMIS

Incidents involved as both Developer and Deployer
  • Incident 1010
    2 Reports

    GenNomis AI Database Reportedly Exposes Nearly 100,000 Deepfake and Nudify Images in Public Breach

More
Entity

GenNomis

Incidents involved as Deployer
  • Incident 1010
    2 Reports

    GenNomis AI Database Reportedly Exposes Nearly 100,000 Deepfake and Nudify Images in Public Breach

Incidents implicated systems
  • Incident 1010
    2 Reports

    GenNomis AI Database Reportedly Exposes Nearly 100,000 Deepfake and Nudify Images in Public Breach

More
Entity

AI-NOMIS

Incidents involved as Developer
  • Incident 1010
    2 Reports

    GenNomis AI Database Reportedly Exposes Nearly 100,000 Deepfake and Nudify Images in Public Breach

More
Entity

Individuals whose likenesses were used without consent

Incidents Harmed By
  • Incident 1010
    2 Reports

    GenNomis AI Database Reportedly Exposes Nearly 100,000 Deepfake and Nudify Images in Public Breach

More
Entity

Public figures and celebrities depicted in explicit AI images

Incidents Harmed By
  • Incident 1010
    2 Reports

    GenNomis AI Database Reportedly Exposes Nearly 100,000 Deepfake and Nudify Images in Public Breach

More
Entity

Unnamed cloud database

Incidents implicated systems
  • Incident 1010
    2 Reports

    GenNomis AI Database Reportedly Exposes Nearly 100,000 Deepfake and Nudify Images in Public Breach

More
Entity

WhatsApp users

Incidents Harmed By
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

More
Entity

Users of Meta platforms

Incidents Harmed By
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

More
Entity

Facebook users

Incidents Harmed By
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

More
Entity

WhatsApp Chatbots

Incidents implicated systems
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

More
Entity

User-Generated Chatbots

Incidents implicated systems
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

More
Entity

Meta Content Moderation Filters

Incidents implicated systems
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

More
Entity

Meta AI with Celebrity Voice Skins

Incidents implicated systems
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

More
Entity

Meta AI Studio Platform

Incidents implicated systems
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

More
Entity

Meta AI Personas

Incidents implicated systems
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

More
Entity

Meta AI

Incidents implicated systems
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

More
Entity

Meta age verification system

Incidents implicated systems
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

More
Entity

Instagram Messaging

Incidents implicated systems
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

More
Entity

Facebook Messenger

Incidents implicated systems
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

More

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2024 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • ecd56df