Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Descubrir
Enviar
  • Bienvenido a la AIID
  • Descubrir Incidentes
  • Vista espacial
  • Vista Tabular
  • Vista de lista
  • Entidades
  • Taxonomías
  • Enviar Informes de Incidentes
  • Ranking de Reportadores
  • Blog
  • Resumen de noticias de IA
  • Control de Riesgos
  • Incidente aleatorio
  • Registrarse
Colapsar
Descubrir
Enviar
  • Bienvenido a la AIID
  • Descubrir Incidentes
  • Vista espacial
  • Vista Tabular
  • Vista de lista
  • Entidades
  • Taxonomías
  • Enviar Informes de Incidentes
  • Ranking de Reportadores
  • Blog
  • Resumen de noticias de IA
  • Control de Riesgos
  • Incidente aleatorio
  • Registrarse
Colapsar
Entidades

Children

Afectado por Incidentes

Incidente 62418 Reportes
Child Sexual Abuse Material Taints Image Generators

2023-12-20

The LAION-5B dataset (a commonly used dataset with more than 5 billion image-description pairs) was found by researchers to contain child sexual abuse material (CSAM), which increases the likelihood that downstream models will produce CSAM imagery. The discovery taints models built with the LAION dataset requiring many organizations to retrain those models. Additionally, LAION must now scrub the dataset of the imagery.

Más

Incidente 5516 Reportes
Alexa Plays Pornography Instead of Kids Song

2016-12-30

An Amazon Echo Dot using the Amazon Alex software started to play pornographic results when a child asked it to play a song.

Más

Incidente 114 Reportes
Google’s YouTube Kids App Presents Inappropriate Content

2015-05-19

YouTube’s content filtering and recommendation algorithms exposed children to disturbing and inappropriate videos.

Más

Incidente 95811 Reportes
Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material

2025-02-26

Europol’s Operation Cumberland uncovered a global network distributing AI-generated child sexual abuse material (CSAM). The operation has led to 25 arrests and 273 identified suspects across 19 countries. The AI-enabled abuse allows criminals to create exploitative content at scale with minimal expertise.

Más

Entidades relacionadas
Otras entidades que están relacionadas con el mismo incidente. Por ejemplo, si el desarrollador de un incidente es esta entidad pero el implementador es otra entidad, se marcan como entidades relacionadas.
 

Entity

YouTube

Incidentes involucrados como desarrollador e implementador
  • Incidente 1
    14 Report

    Google’s YouTube Kids App Presents Inappropriate Content

Más
Entity

Amazon

Incidentes involucrados como desarrollador e implementador
  • Incidente 55
    16 Report

    Alexa Plays Pornography Instead of Kids Song

Más
Entity

OpenAI

Incidentes involucrados como desarrollador e implementador
  • Incidente 561
    3 Report

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

Más
Entity

internet users

Afectado por Incidentes
  • Incidente 561
    3 Report

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

Más
Entity

social media users

Afectado por Incidentes
  • Incidente 561
    3 Report

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

Más
Entity

Meta

Incidentes involucrados como desarrollador e implementador
  • Incidente 723
    2 Report

    Instagram Algorithms Reportedly Directed Children's Merchandise Ad Campaign to Adult Men and Sex Offenders

  • Incidente 583
    1 Report

    Instagram Algorithms Allegedly Promote Accounts Facilitating Child Sex Abuse Content

Más
Entity

Instagram

Incidentes involucrados como desarrollador e implementador
  • Incidente 583
    1 Report

    Instagram Algorithms Allegedly Promote Accounts Facilitating Child Sex Abuse Content

  • Incidente 788
    1 Report

    Instagram's Algorithm Reportedly Recommended Sexual Content to Teenagers' Accounts

Incidents involved as Deployer
  • Incidente 723
    2 Report

    Instagram Algorithms Reportedly Directed Children's Merchandise Ad Campaign to Adult Men and Sex Offenders

Más
Entity

General public

Afectado por Incidentes
  • Incidente 624
    18 Report

    Child Sexual Abuse Material Taints Image Generators

  • Incidente 583
    1 Report

    Instagram Algorithms Allegedly Promote Accounts Facilitating Child Sex Abuse Content

Más
Entity

minors

Afectado por Incidentes
  • Incidente 958
    11 Report

    Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material

  • Incidente 583
    1 Report

    Instagram Algorithms Allegedly Promote Accounts Facilitating Child Sex Abuse Content

Más
Entity

teenagers

Afectado por Incidentes
  • Incidente 583
    1 Report

    Instagram Algorithms Allegedly Promote Accounts Facilitating Child Sex Abuse Content

Más
Entity

Various people

Afectado por Incidentes
  • Incidente 624
    18 Report

    Child Sexual Abuse Material Taints Image Generators

Incidents involved as Deployer
  • Incidente 624
    18 Report

    Child Sexual Abuse Material Taints Image Generators

Más
Entity

Various organizations

Afectado por Incidentes
  • Incidente 624
    18 Report

    Child Sexual Abuse Material Taints Image Generators

Incidents involved as Deployer
  • Incidente 624
    18 Report

    Child Sexual Abuse Material Taints Image Generators

Más
Entity

LAION

Afectado por Incidentes
  • Incidente 624
    18 Report

    Child Sexual Abuse Material Taints Image Generators

Incidents involved as Developer
  • Incidente 624
    18 Report

    Child Sexual Abuse Material Taints Image Generators

Más
Entity

Instagram users

Afectado por Incidentes
  • Incidente 723
    2 Report

    Instagram Algorithms Reportedly Directed Children's Merchandise Ad Campaign to Adult Men and Sex Offenders

  • Incidente 788
    1 Report

    Instagram's Algorithm Reportedly Recommended Sexual Content to Teenagers' Accounts

Más
Entity

Instagram sellers

Afectado por Incidentes
  • Incidente 723
    2 Report

    Instagram Algorithms Reportedly Directed Children's Merchandise Ad Campaign to Adult Men and Sex Offenders

Más
Entity

Unknown AI developers

Incidents involved as Developer
  • Incidente 784
    1 Report

    Child Predators Are Reportedly Generating Deepfake Nudes of Children to Extort Them

Incidents involved as Deployer
  • Incidente 780
    1 Report

    Joint Base Elmendorf-Richardson Soldier Faces Allegations of Using AI to Generate Child Pornography

Más
Entity

Seth Herrera

Incidents involved as Developer
  • Incidente 780
    1 Report

    Joint Base Elmendorf-Richardson Soldier Faces Allegations of Using AI to Generate Child Pornography

Más
Entity

Unknown Dark Web users

Incidents involved as Deployer
  • Incidente 784
    1 Report

    Child Predators Are Reportedly Generating Deepfake Nudes of Children to Extort Them

Más
Entity

Unknown deepfake creators

Incidentes involucrados como desarrollador e implementador
  • Incidente 784
    1 Report

    Child Predators Are Reportedly Generating Deepfake Nudes of Children to Extort Them

Más
Entity

Meta Platforms

Incidentes involucrados como desarrollador e implementador
  • Incidente 788
    1 Report

    Instagram's Algorithm Reportedly Recommended Sexual Content to Teenagers' Accounts

Más
Entity

Suspects identified in Operation Cumberland

Incidents involved as Deployer
  • Incidente 958
    11 Report

    Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material

Más
Entity

CSAM distributors

Incidents involved as Deployer
  • Incidente 958
    11 Report

    Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material

Más
Entity

Unknown deepfake technology developer

Incidents involved as Developer
  • Incidente 958
    11 Report

    Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material

Más
Entity

Unknown deepfake CSAM tools

Incidents involved as Developer
  • Incidente 958
    11 Report

    Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material

Más
Entity

Potential victims of exploitation

Afectado por Incidentes
  • Incidente 958
    11 Report

    Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material

Más
Entity

Unknown deepfake apps

Incidents implicated systems
  • Incidente 958
    11 Report

    Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material

Más
Entity

Unknown CSAM apps

Incidents implicated systems
  • Incidente 958
    11 Report

    Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material

Más
Entity

Dark web marketplaces

Incidents implicated systems
  • Incidente 958
    11 Report

    Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material

Más

Investigación

  • Definición de un “Incidente de IA”
  • Definición de una “Respuesta a incidentes de IA”
  • Hoja de ruta de la base de datos
  • Trabajo relacionado
  • Descargar Base de Datos Completa

Proyecto y Comunidad

  • Acerca de
  • Contactar y Seguir
  • Aplicaciones y resúmenes
  • Guía del editor

Incidencias

  • Todos los incidentes en forma de lista
  • Incidentes marcados
  • Cola de envío
  • Vista de clasificaciones
  • Taxonomías

2024 - AI Incident Database

  • Condiciones de uso
  • Política de privacidad
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • 1420c8e