Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Entities

LAION

Incidents Harmed By

Incident 62418 Report
Child Sexual Abuse Material Taints Image Generators

2023-12-20

The LAION-5B dataset (a commonly used dataset with more than 5 billion image-description pairs) was found by researchers to contain child sexual abuse material (CSAM), which increases the likelihood that downstream models will produce CSAM imagery. The discovery taints models built with the LAION dataset requiring many organizations to retrain those models. Additionally, LAION must now scrub the dataset of the imagery.

More

Incidents involved as Developer

Incident 62418 Report
Child Sexual Abuse Material Taints Image Generators

2023-12-20

The LAION-5B dataset (a commonly used dataset with more than 5 billion image-description pairs) was found by researchers to contain child sexual abuse material (CSAM), which increases the likelihood that downstream models will produce CSAM imagery. The discovery taints models built with the LAION dataset requiring many organizations to retrain those models. Additionally, LAION must now scrub the dataset of the imagery.

More

Incident 42112 Report
Stable Diffusion Allegedly Used Artists' Works without Permission for AI Training

2022-11-20

Text-to-image model Stable Diffusion was reportedly using artists' original works without permission for its AI training.

More

Incident 4235 Report
Lensa AI's Produced Unintended Sexually Explicit or Suggestive "Magic Avatars" for Women

2022-11-22

Lensa AI's "Magic Avatars" were reportedly generating sexually explicit and sexualized features disproportionately for women and Asian women despite not submitting any sexual content.

More

Incident 4515 Report
Stable Diffusion's Training Data Contained Copyrighted Images

2022-10-16

Stability AI reportedly scraped copyrighted images by Getty Images to be used as training data for Stable Diffusion model.

More

Related Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
 

Entity

Stability AI

Incidents involved as both Developer and Deployer
  • Incident 421
    12 Reports

    Stable Diffusion Allegedly Used Artists' Works without Permission for AI Training

  • Incident 451
    5 Reports

    Stable Diffusion's Training Data Contained Copyrighted Images

Incidents Harmed By
  • Incident 314
    1 Report

    Stable Diffusion Abused by 4chan Users to Deepfake Celebrity Porn

Incidents involved as Developer
  • Incident 423
    5 Reports

    Lensa AI's Produced Unintended Sexually Explicit or Suggestive "Magic Avatars" for Women

More
Entity

Runway

Incidents involved as Developer
  • Incident 421
    12 Reports

    Stable Diffusion Allegedly Used Artists' Works without Permission for AI Training

  • Incident 423
    5 Reports

    Lensa AI's Produced Unintended Sexually Explicit or Suggestive "Magic Avatars" for Women

More
Entity

EleutherAI

Incidents involved as Developer
  • Incident 421
    12 Reports

    Stable Diffusion Allegedly Used Artists' Works without Permission for AI Training

  • Incident 423
    5 Reports

    Lensa AI's Produced Unintended Sexually Explicit or Suggestive "Magic Avatars" for Women

More
Entity

CompVis LMU

Incidents involved as Developer
  • Incident 421
    12 Reports

    Stable Diffusion Allegedly Used Artists' Works without Permission for AI Training

  • Incident 423
    5 Reports

    Lensa AI's Produced Unintended Sexually Explicit or Suggestive "Magic Avatars" for Women

More
Entity

deepfaked celebrities

Incidents Harmed By
  • Incident 314
    1 Report

    Stable Diffusion Abused by 4chan Users to Deepfake Celebrity Porn

More
Entity

Lensa AI

Incidents involved as both Developer and Deployer
  • Incident 421
    12 Reports

    Stable Diffusion Allegedly Used Artists' Works without Permission for AI Training

  • Incident 423
    5 Reports

    Lensa AI's Produced Unintended Sexually Explicit or Suggestive "Magic Avatars" for Women

More
Entity

Midjourney

Incidents involved as Deployer
  • Incident 421
    12 Reports

    Stable Diffusion Allegedly Used Artists' Works without Permission for AI Training

More
Entity

DeviantArt

Incidents involved as Deployer
  • Incident 421
    12 Reports

    Stable Diffusion Allegedly Used Artists' Works without Permission for AI Training

More
Entity

digital artists

Incidents Harmed By
  • Incident 421
    12 Reports

    Stable Diffusion Allegedly Used Artists' Works without Permission for AI Training

More
Entity

artists publishing on social media

Incidents Harmed By
  • Incident 421
    12 Reports

    Stable Diffusion Allegedly Used Artists' Works without Permission for AI Training

More
Entity

artists

Incidents Harmed By
  • Incident 421
    12 Reports

    Stable Diffusion Allegedly Used Artists' Works without Permission for AI Training

More
Entity

women using Lensa AI

Incidents Harmed By
  • Incident 423
    5 Reports

    Lensa AI's Produced Unintended Sexually Explicit or Suggestive "Magic Avatars" for Women

More
Entity

Asian women using Lensa AI

Incidents Harmed By
  • Incident 423
    5 Reports

    Lensa AI's Produced Unintended Sexually Explicit or Suggestive "Magic Avatars" for Women

More
Entity

Getty Images

Incidents Harmed By
  • Incident 451
    5 Reports

    Stable Diffusion's Training Data Contained Copyrighted Images

More
Entity

Getty Images contributors

Incidents Harmed By
  • Incident 451
    5 Reports

    Stable Diffusion's Training Data Contained Copyrighted Images

More
Entity

Google

Incidents involved as both Developer and Deployer
  • Incident 465
    1 Report

    Generative Models Trained on Dataset Containing Private Medical Photos

More
Entity

people having medical photos online

Incidents Harmed By
  • Incident 465
    1 Report

    Generative Models Trained on Dataset Containing Private Medical Photos

More
Entity

racial minority groups

Incidents Harmed By
  • Incident 529
    3 Reports

    Stable Diffusion Exhibited Biases for Prompts Featuring Professions

More
Entity

Women

Incidents Harmed By
  • Incident 529
    3 Reports

    Stable Diffusion Exhibited Biases for Prompts Featuring Professions

More
Entity

gender minority groups

Incidents Harmed By
  • Incident 529
    3 Reports

    Stable Diffusion Exhibited Biases for Prompts Featuring Professions

More
Entity

Various people

Incidents Harmed By
  • Incident 624
    18 Reports

    Child Sexual Abuse Material Taints Image Generators

  • Incident 624
    18 Reports

    Child Sexual Abuse Material Taints Image Generators

Incidents involved as Deployer
  • Incident 624
    18 Reports

    Child Sexual Abuse Material Taints Image Generators

  • Incident 624
    18 Reports

    Child Sexual Abuse Material Taints Image Generators

More
Entity

Various organizations

Incidents Harmed By
  • Incident 624
    18 Reports

    Child Sexual Abuse Material Taints Image Generators

  • Incident 624
    18 Reports

    Child Sexual Abuse Material Taints Image Generators

Incidents involved as Deployer
  • Incident 624
    18 Reports

    Child Sexual Abuse Material Taints Image Generators

  • Incident 624
    18 Reports

    Child Sexual Abuse Material Taints Image Generators

More
Entity

General public

Incidents Harmed By
  • Incident 624
    18 Reports

    Child Sexual Abuse Material Taints Image Generators

  • Incident 624
    18 Reports

    Child Sexual Abuse Material Taints Image Generators

More
Entity

Children

Incidents Harmed By
  • Incident 624
    18 Reports

    Child Sexual Abuse Material Taints Image Generators

  • Incident 624
    18 Reports

    Child Sexual Abuse Material Taints Image Generators

More

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2024 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • ecd56df