Incident 661: Leonardo AI's Platform Alleged to Have Been Used for Creating Nonconsensual Celebrity Deepfakes

Description: Sydney-based startup Leonardo AI's text-to-image generator was alleged to have been exploited to create nonconsensual sexual images of celebrities, bypassing content moderation systems with user-shared prompts.

Tools

New ReportNew ReportNew ResponseNew ResponseDiscoverDiscoverView HistoryView History
Alleged: Leonardo AI developed an AI system deployed by Telegram community users , Reddit users and Leonardo AI users, which harmed public figures and celebrities.

Incident Stats

Incident ID
661
Report Count
1
Incident Date
2024-03-26
Editors
Daniel Atherton

Incident Reports

Generative AI startup Leonardo is being used to make deepfake celebrity porn
startupdaily.net · 2024
The text-to-image generator developed by Sydney startup Leonardo Ai has been used to create deepfake porn of celebrities.

Journalist Emanuel Maiberg at US tech news website 404 Media reported that they had used prompt suggestions for Leonar…

Variants

A "variant" is an incident that shares the same causative factors, produces similar harms, and involves the same intelligent systems as a known AI incident. Rather than index variants as entirely separate incidents, we list variations of incidents under the first similar incident submitted to the database. Unlike other submission types to the incident database, variants are not required to have reporting in evidence external to the Incident Database. Learn more from the research paper.