Incident 314: Stable Diffusion Abused by 4chan Users to Deepfake Celebrity Porn

Description: Stable Diffusion, an open-source image generation model by Stability AI, was reportedly leaked on 4chan prior to its release date, and was used by its users to generate pornographic deepfakes of celebrities.

Tools

New ReportNew ReportNew ResponseNew ResponseDiscoverDiscoverView HistoryView History
Alleged: Stability AI , Runway , LAION , EleutherAI and CompVis LMU developed an AI system deployed by Stability AI, which harmed Stability AI and deepfaked celebrities.

Incident Stats

Incident ID
314
Report Count
1
Incident Date
2022-08-17
Editors
Khoa Lam

Incident Reports

Deepfakes: Uncensored AI art model prompts ethics questions
techcrunch.com · 2022

A new open source AI image generator capable of producing realistic pictures from any text prompt has seen stunningly swift uptake in its first week. Stability AI’s Stable Diffusion, high fidelity but capable of being run on off-the-shelf c…

Variants

A "variant" is an incident that shares the same causative factors, produces similar harms, and involves the same intelligent systems as a known AI incident. Rather than index variants as entirely separate incidents, we list variations of incidents under the first similar incident submitted to the database. Unlike other submission types to the incident database, variants are not required to have reporting in evidence external to the Incident Database. Learn more from the research paper.