Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Entities

Stability AI

Incidents involved as both Developer and Deployer

Incident 42112 Report
Stable Diffusion Allegedly Used Artists' Works without Permission for AI Training

2022-11-20

Text-to-image model Stable Diffusion was reportedly using artists' original works without permission for its AI training.

More

Incident 4515 Report
Stable Diffusion's Training Data Contained Copyrighted Images

2022-10-16

Stability AI reportedly scraped copyrighted images by Getty Images to be used as training data for Stable Diffusion model.

More

Incident 5293 Report
Stable Diffusion Exhibited Biases for Prompts Featuring Professions

2022-08-22

Stable Diffusion reportedly posed risks of bias and stereotyping along gender and cultural lines for prompts containing descriptors and professions.

More

Incident 3141 Report
Stable Diffusion Abused by 4chan Users to Deepfake Celebrity Porn

2022-08-17

Stable Diffusion, an open-source image generation model by Stability AI, was reportedly leaked on 4chan prior to its release date, and was used by its users to generate pornographic deepfakes of celebrities.

More

Incidents Harmed By

Incident 3141 Report
Stable Diffusion Abused by 4chan Users to Deepfake Celebrity Porn

2022-08-17

Stable Diffusion, an open-source image generation model by Stability AI, was reportedly leaked on 4chan prior to its release date, and was used by its users to generate pornographic deepfakes of celebrities.

More

Incidents involved as Developer

Incident 4235 Report
Lensa AI's Produced Unintended Sexually Explicit or Suggestive "Magic Avatars" for Women

2022-11-22

Lensa AI's "Magic Avatars" were reportedly generating sexually explicit and sexualized features disproportionately for women and Asian women despite not submitting any sexual content.

More

Incident 4625 Report
AI-Produced Livestream Sitcom Received Temporary Twitch Ban for Transphobic Segment

2023-02-06

The AI-produced, procedural generated sitcom broadcasted as a Twitch livestream "Nothing, Forever" received a temporary ban for featuring a transphobic and homophobic dialogue segment intended as comedy.

More

Incident 6894 Report
Holmen, Wisconsin Man Allegedly Used Stable Diffusion to Create and Then Share Sexually Explicit Images Depicting Minors

2024-03-26

The FBI has arrested Steven Anderegg of Holmen, Wisconsin for having allegedly used Stable Diffusion to generate about 13,000 sexually explicit images of minors, which he then is also alleged to have shared and distributed, including with at least one minor, via Telegram and Instagram. Anderegg was originally apprehended by state police in March, and this case marks one of the first times the FBI has brought charges against someone for having used AI to generate CSAM.

More

Related Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
 

Entity

Runway

Incidents involved as Developer
  • Incident 421
    12 Reports

    Stable Diffusion Allegedly Used Artists' Works without Permission for AI Training

  • Incident 451
    5 Reports

    Stable Diffusion's Training Data Contained Copyrighted Images

More
Entity

LAION

Incidents involved as Developer
  • Incident 421
    12 Reports

    Stable Diffusion Allegedly Used Artists' Works without Permission for AI Training

  • Incident 451
    5 Reports

    Stable Diffusion's Training Data Contained Copyrighted Images

More
Entity

EleutherAI

Incidents involved as Developer
  • Incident 421
    12 Reports

    Stable Diffusion Allegedly Used Artists' Works without Permission for AI Training

  • Incident 451
    5 Reports

    Stable Diffusion's Training Data Contained Copyrighted Images

More
Entity

CompVis LMU

Incidents involved as Developer
  • Incident 421
    12 Reports

    Stable Diffusion Allegedly Used Artists' Works without Permission for AI Training

  • Incident 451
    5 Reports

    Stable Diffusion's Training Data Contained Copyrighted Images

More
Entity

deepfaked celebrities

Incidents Harmed By
  • Incident 314
    1 Report

    Stable Diffusion Abused by 4chan Users to Deepfake Celebrity Porn

  • Incident 314
    1 Report

    Stable Diffusion Abused by 4chan Users to Deepfake Celebrity Porn

More
Entity

Lensa AI

Incidents involved as both Developer and Deployer
  • Incident 421
    12 Reports

    Stable Diffusion Allegedly Used Artists' Works without Permission for AI Training

  • Incident 423
    5 Reports

    Lensa AI's Produced Unintended Sexually Explicit or Suggestive "Magic Avatars" for Women

More
Entity

Midjourney

Incidents involved as Deployer
  • Incident 421
    12 Reports

    Stable Diffusion Allegedly Used Artists' Works without Permission for AI Training

More
Entity

DeviantArt

Incidents involved as Deployer
  • Incident 421
    12 Reports

    Stable Diffusion Allegedly Used Artists' Works without Permission for AI Training

More
Entity

digital artists

Incidents Harmed By
  • Incident 421
    12 Reports

    Stable Diffusion Allegedly Used Artists' Works without Permission for AI Training

More
Entity

artists publishing on social media

Incidents Harmed By
  • Incident 421
    12 Reports

    Stable Diffusion Allegedly Used Artists' Works without Permission for AI Training

More
Entity

artists

Incidents Harmed By
  • Incident 421
    12 Reports

    Stable Diffusion Allegedly Used Artists' Works without Permission for AI Training

More
Entity

women using Lensa AI

Incidents Harmed By
  • Incident 423
    5 Reports

    Lensa AI's Produced Unintended Sexually Explicit or Suggestive "Magic Avatars" for Women

More
Entity

Asian women using Lensa AI

Incidents Harmed By
  • Incident 423
    5 Reports

    Lensa AI's Produced Unintended Sexually Explicit or Suggestive "Magic Avatars" for Women

More
Entity

Getty Images

Incidents Harmed By
  • Incident 451
    5 Reports

    Stable Diffusion's Training Data Contained Copyrighted Images

More
Entity

Getty Images contributors

Incidents Harmed By
  • Incident 451
    5 Reports

    Stable Diffusion's Training Data Contained Copyrighted Images

More
Entity

Mismatch Media

Incidents involved as Deployer
  • Incident 462
    5 Reports

    AI-Produced Livestream Sitcom Received Temporary Twitch Ban for Transphobic Segment

More
Entity

OpenAI

Incidents involved as Developer
  • Incident 462
    5 Reports

    AI-Produced Livestream Sitcom Received Temporary Twitch Ban for Transphobic Segment

More
Entity

Twitch users

Incidents Harmed By
  • Incident 462
    5 Reports

    AI-Produced Livestream Sitcom Received Temporary Twitch Ban for Transphobic Segment

More
Entity

transgender communities

Incidents Harmed By
  • Incident 462
    5 Reports

    AI-Produced Livestream Sitcom Received Temporary Twitch Ban for Transphobic Segment

More
Entity

LGBTQ communities

Incidents Harmed By
  • Incident 462
    5 Reports

    AI-Produced Livestream Sitcom Received Temporary Twitch Ban for Transphobic Segment

More
Entity

Google

Incidents involved as both Developer and Deployer
  • Incident 465
    1 Report

    Generative Models Trained on Dataset Containing Private Medical Photos

More
Entity

people having medical photos online

Incidents Harmed By
  • Incident 465
    1 Report

    Generative Models Trained on Dataset Containing Private Medical Photos

More
Entity

racial minority groups

Incidents Harmed By
  • Incident 529
    3 Reports

    Stable Diffusion Exhibited Biases for Prompts Featuring Professions

More
Entity

Women

Incidents Harmed By
  • Incident 529
    3 Reports

    Stable Diffusion Exhibited Biases for Prompts Featuring Professions

More
Entity

gender minority groups

Incidents Harmed By
  • Incident 529
    3 Reports

    Stable Diffusion Exhibited Biases for Prompts Featuring Professions

More
Entity

Steven Anderegg

Incidents involved as Deployer
  • Incident 689
    4 Reports

    Holmen, Wisconsin Man Allegedly Used Stable Diffusion to Create and Then Share Sexually Explicit Images Depicting Minors

More
Entity

Stable Diffusion

Incidents involved as Developer
  • Incident 689
    4 Reports

    Holmen, Wisconsin Man Allegedly Used Stable Diffusion to Create and Then Share Sexually Explicit Images Depicting Minors

More
Entity

minors

Incidents Harmed By
  • Incident 689
    4 Reports

    Holmen, Wisconsin Man Allegedly Used Stable Diffusion to Create and Then Share Sexually Explicit Images Depicting Minors

More
Entity

General public

Incidents Harmed By
  • Incident 689
    4 Reports

    Holmen, Wisconsin Man Allegedly Used Stable Diffusion to Create and Then Share Sexually Explicit Images Depicting Minors

More

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2024 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • ecd56df