Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Découvrir
Envoyer
  • Bienvenue sur AIID
  • Découvrir les incidents
  • Vue spatiale
  • Vue de tableau
  • Vue de liste
  • Entités
  • Taxonomies
  • Soumettre des rapports d'incident
  • Classement des reporters
  • Blog
  • Résumé de l’Actualité sur l’IA
  • Contrôle des risques
  • Incident au hasard
  • S'inscrire
Fermer
Découvrir
Envoyer
  • Bienvenue sur AIID
  • Découvrir les incidents
  • Vue spatiale
  • Vue de tableau
  • Vue de liste
  • Entités
  • Taxonomies
  • Soumettre des rapports d'incident
  • Classement des reporters
  • Blog
  • Résumé de l’Actualité sur l’IA
  • Contrôle des risques
  • Incident au hasard
  • S'inscrire
Fermer
Entités

minors

Affecté par des incidents

Incident 95811 Rapports
Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material

2025-02-26

Europol’s Operation Cumberland uncovered a global network distributing AI-generated child sexual abuse material (CSAM). The operation has led to 25 arrests and 273 identified suspects across 19 countries. The AI-enabled abuse allows criminals to create exploitative content at scale with minimal expertise.

Plus

Incident 6894 Rapports
Holmen, Wisconsin Man Allegedly Used Stable Diffusion to Create and Then Share Sexually Explicit Images Depicting Minors

2024-03-26

The FBI has arrested Steven Anderegg of Holmen, Wisconsin for having allegedly used Stable Diffusion to generate about 13,000 sexually explicit images of minors, which he then is also alleged to have shared and distributed, including with at least one minor, via Telegram and Instagram. Anderegg was originally apprehended by state police in March, and this case marks one of the first times the FBI has brought charges against someone for having used AI to generate CSAM.

Plus

Incident 10102 Rapports
GenNomis AI Database Reportedly Exposes Nearly 100,000 Deepfake and Nudify Images in Public Breach

2025-03-31

In March 2025, cybersecurity researcher Jeremiah Fowler discovered an unprotected database linked to GenNomis by AI-NOMIS, a South Korean company offering face-swapping and "nudify" AI services. The exposed 47.8GB dataset included nearly 100,000 files. Many depicted explicit deepfake images, some involving minors or celebrities. No personal data was found, but the breach was a serious failure in data security and consent safeguards in AI image-generation platforms.

Plus

Incident 5831 Rapport
Instagram Algorithms Allegedly Promote Accounts Facilitating Child Sex Abuse Content

2023-06-07

An investigation disclosed that Instagram's recommendation algorithms are promoting accounts that facilitate and sell child sexual abuse material (CSAM). The study, conducted by The Wall Street Journal and researchers at Stanford University and the University of Massachusetts Amherst, indicates that Instagram's algorithms not only allow for the discovery of such accounts through keyword searches but also actively recommend them to users within the network. The issue is especially concerning given Instagram's popularity among teenagers.

Plus

Entités liées
Autres entités liées au même incident. Par exemple, si le développeur d'un incident est cette entité mais que le responsable de la mise en œuvre est une autre entité, ils sont marqués comme entités liées.
 

Entity

Meta

Incidents impliqués en tant que développeur et déployeur
  • Incident 583
    1 Report

    Instagram Algorithms Allegedly Promote Accounts Facilitating Child Sex Abuse Content

  • Incident 957
    1 Report

    Alleged Instagram Algorithm Malfunction Floods Users’ Reels Feeds with Violent and Graphic Content

Plus
Entity

Instagram

Incidents impliqués en tant que développeur et déployeur
  • Incident 583
    1 Report

    Instagram Algorithms Allegedly Promote Accounts Facilitating Child Sex Abuse Content

  • Incident 788
    1 Report

    Instagram's Algorithm Reportedly Recommended Sexual Content to Teenagers' Accounts

Plus
Entity

Children

Affecté par des incidents
  • Incident 958
    11 Report

    Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material

  • Incident 583
    1 Report

    Instagram Algorithms Allegedly Promote Accounts Facilitating Child Sex Abuse Content

Plus
Entity

General public

Affecté par des incidents
  • Incident 689
    4 Report

    Holmen, Wisconsin Man Allegedly Used Stable Diffusion to Create and Then Share Sexually Explicit Images Depicting Minors

  • Incident 1010
    2 Report

    GenNomis AI Database Reportedly Exposes Nearly 100,000 Deepfake and Nudify Images in Public Breach

Plus
Entity

teenagers

Affecté par des incidents
  • Incident 583
    1 Report

    Instagram Algorithms Allegedly Promote Accounts Facilitating Child Sex Abuse Content

Plus
Entity

Replika

Incidents impliqués en tant que développeur et déployeur
  • Incident 491
    1 Report

    Replika's AI Experience Reportedly Lacked Protection for Minors, Resulting in Data Ban

Plus
Entity

Snapchat

Incidents impliqués en tant que développeur et déployeur
  • Incident 539
    1 Report

    Snapchat's My AI Reported for Lacking Protection for Children

  • Incident 646
    1 Report

    Snapchat's Algorithm Alleged to Link Minor with Sex Offenders

Plus
Entity

OpenAI

Incidents involved as Developer
  • Incident 539
    1 Report

    Snapchat's My AI Reported for Lacking Protection for Children

Plus
Entity

Microsoft

Incidents impliqués en tant que développeur et déployeur
  • Incident 654
    1 Report

    Microsoft Copilot Designer Reportedly Generated Inappropriate AI Images

Plus
Entity

Steven Anderegg

Incidents involved as Deployer
  • Incident 689
    4 Report

    Holmen, Wisconsin Man Allegedly Used Stable Diffusion to Create and Then Share Sexually Explicit Images Depicting Minors

Plus
Entity

Stable Diffusion

Incidents involved as Developer
  • Incident 689
    4 Report

    Holmen, Wisconsin Man Allegedly Used Stable Diffusion to Create and Then Share Sexually Explicit Images Depicting Minors

Plus
Entity

Stability AI

Incidents involved as Developer
  • Incident 689
    4 Report

    Holmen, Wisconsin Man Allegedly Used Stable Diffusion to Create and Then Share Sexually Explicit Images Depicting Minors

Plus
Entity

Meta Platforms

Incidents impliqués en tant que développeur et déployeur
  • Incident 788
    1 Report

    Instagram's Algorithm Reportedly Recommended Sexual Content to Teenagers' Accounts

Plus
Entity

Instagram users

Affecté par des incidents
  • Incident 788
    1 Report

    Instagram's Algorithm Reportedly Recommended Sexual Content to Teenagers' Accounts

  • Incident 957
    1 Report

    Alleged Instagram Algorithm Malfunction Floods Users’ Reels Feeds with Violent and Graphic Content

Plus
Entity

Meta users

Affecté par des incidents
  • Incident 957
    1 Report

    Alleged Instagram Algorithm Malfunction Floods Users’ Reels Feeds with Violent and Graphic Content

Plus
Entity

Instagram recommendation algorithm

Incidents implicated systems
  • Incident 957
    1 Report

    Alleged Instagram Algorithm Malfunction Floods Users’ Reels Feeds with Violent and Graphic Content

Plus
Entity

Instagram Reels

Incidents implicated systems
  • Incident 957
    1 Report

    Alleged Instagram Algorithm Malfunction Floods Users’ Reels Feeds with Violent and Graphic Content

Plus
Entity

Suspects identified in Operation Cumberland

Incidents involved as Deployer
  • Incident 958
    11 Report

    Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material

Plus
Entity

CSAM distributors

Incidents involved as Deployer
  • Incident 958
    11 Report

    Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material

Plus
Entity

Unknown deepfake technology developer

Incidents involved as Developer
  • Incident 958
    11 Report

    Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material

  • Incident 1006
    1 Report

    Edinburg, Texas Police Officer Arrested for Alleged Possession of CSAM, Including AI-Generated Deepfakes of Minors

Plus
Entity

Unknown deepfake CSAM tools

Incidents involved as Developer
  • Incident 958
    11 Report

    Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material

Plus
Entity

Potential victims of exploitation

Affecté par des incidents
  • Incident 958
    11 Report

    Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material

Plus
Entity

Unknown deepfake apps

Incidents implicated systems
  • Incident 958
    11 Report

    Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material

Plus
Entity

Unknown CSAM apps

Incidents implicated systems
  • Incident 958
    11 Report

    Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material

Plus
Entity

Dark web marketplaces

Incidents implicated systems
  • Incident 958
    11 Report

    Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material

Plus
Entity

Preston Wade Pietrzykowski

Incidents involved as Deployer
  • Incident 1006
    1 Report

    Edinburg, Texas Police Officer Arrested for Alleged Possession of CSAM, Including AI-Generated Deepfakes of Minors

Plus
Entity

General public of Texas

Affecté par des incidents
  • Incident 1006
    1 Report

    Edinburg, Texas Police Officer Arrested for Alleged Possession of CSAM, Including AI-Generated Deepfakes of Minors

Plus
Entity

Texas Department of Public Safety

Affecté par des incidents
  • Incident 1006
    1 Report

    Edinburg, Texas Police Officer Arrested for Alleged Possession of CSAM, Including AI-Generated Deepfakes of Minors

Plus
Entity

Unknown deepfake app

Incidents implicated systems
  • Incident 1006
    1 Report

    Edinburg, Texas Police Officer Arrested for Alleged Possession of CSAM, Including AI-Generated Deepfakes of Minors

Plus
Entity

GenNomis by AI-NOMIS

Incidents impliqués en tant que développeur et déployeur
  • Incident 1010
    2 Report

    GenNomis AI Database Reportedly Exposes Nearly 100,000 Deepfake and Nudify Images in Public Breach

Plus
Entity

GenNomis

Incidents involved as Deployer
  • Incident 1010
    2 Report

    GenNomis AI Database Reportedly Exposes Nearly 100,000 Deepfake and Nudify Images in Public Breach

Incidents implicated systems
  • Incident 1010
    2 Report

    GenNomis AI Database Reportedly Exposes Nearly 100,000 Deepfake and Nudify Images in Public Breach

Plus
Entity

AI-NOMIS

Incidents involved as Developer
  • Incident 1010
    2 Report

    GenNomis AI Database Reportedly Exposes Nearly 100,000 Deepfake and Nudify Images in Public Breach

Plus
Entity

Individuals whose likenesses were used without consent

Affecté par des incidents
  • Incident 1010
    2 Report

    GenNomis AI Database Reportedly Exposes Nearly 100,000 Deepfake and Nudify Images in Public Breach

Plus
Entity

Public figures and celebrities depicted in explicit AI images

Affecté par des incidents
  • Incident 1010
    2 Report

    GenNomis AI Database Reportedly Exposes Nearly 100,000 Deepfake and Nudify Images in Public Breach

Plus
Entity

Unnamed cloud database

Incidents implicated systems
  • Incident 1010
    2 Report

    GenNomis AI Database Reportedly Exposes Nearly 100,000 Deepfake and Nudify Images in Public Breach

Plus
Entity

WhatsApp users

Affecté par des incidents
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

Plus
Entity

Users of Meta platforms

Affecté par des incidents
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

Plus
Entity

Facebook users

Affecté par des incidents
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

Plus
Entity

WhatsApp Chatbots

Incidents implicated systems
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

Plus
Entity

User-Generated Chatbots

Incidents implicated systems
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

Plus
Entity

Meta Content Moderation Filters

Incidents implicated systems
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

Plus
Entity

Meta AI with Celebrity Voice Skins

Incidents implicated systems
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

Plus
Entity

Meta AI Studio Platform

Incidents implicated systems
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

Plus
Entity

Meta AI Personas

Incidents implicated systems
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

Plus
Entity

Meta AI

Incidents implicated systems
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

Plus
Entity

Meta age verification system

Incidents implicated systems
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

Plus
Entity

Instagram Messaging

Incidents implicated systems
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

Plus
Entity

Facebook Messenger

Incidents implicated systems
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

Plus

Recherche

  • Définition d'un « incident d'IA »
  • Définir une « réponse aux incidents d'IA »
  • Feuille de route de la base de données
  • Travaux connexes
  • Télécharger la base de données complète

Projet et communauté

  • À propos de
  • Contacter et suivre
  • Applications et résumés
  • Guide de l'éditeur

Incidents

  • Tous les incidents sous forme de liste
  • Incidents signalés
  • File d'attente de soumission
  • Affichage des classifications
  • Taxonomies

2024 - AI Incident Database

  • Conditions d'utilisation
  • Politique de confidentialité
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • 1420c8e