Incident 314: Stable Diffusion Abused by 4chan Users to Deepfake Celebrity Porn

Description: Stable Diffusion, an open-source image generation model by Stability AI, was reportedly leaked on 4chan prior to its release date, and was used by its users to generate pornographic deepfakes of celebrities.
Alleged: Stability AI , Runway , LAION , EleutherAI and CompVis LMU developed an AI system deployed by Stability AI, which harmed Stability AI and deepfaked celebrities.

Suggested citation format

Atherton, Daniel. (2022-08-17) Incident Number 314. in Lam, K. (ed.) Artificial Intelligence Incident Database. Responsible AI Collaborative.

Incident Stats

Incident ID
314
Report Count
1
Incident Date
2022-08-17
Editors
Khoa Lam

Tools

New ReportNew ReportNew ResponseNew ResponseDiscoverDiscover

Incident Reports

Deepfakes: Uncensored AI art model prompts ethics questions

A new open source AI image generator capable of producing realistic pictures from any text prompt has seen stunningly swift uptake in its first week. Stability AI’s Stable Diffusion, high fidelity but capable of being run on off-the-shelf c…

Variants

A "variant" is an incident that shares the same causative factors, produces similar harms, and involves the same intelligent systems as a known AI incident. Rather than index variants as entirely separate incidents, we list variations of incidents under the first similar incident submitted to the database. Unlike other submission types to the incident database, variants are not required to have reporting in evidence external to the Incident Database. Learn more from the research paper.