Incident 530: Telegram Channels Allowed Users to Make Non-Consensual Deepfake Porn as Paid Service
Description: Seven channels were connected in a Telegram ecosystem centered around letting subscribers, as a paid service, generate non-consensual deepfake nudes using a bot from submitted photos of women, including underage girls and women who they know in real life.
Entities
View all entitiesAlleged: Telegram channels and Alberto developed an AI system deployed by Telegram channels, which harmed Women , underage girls and female celebrities.
Incident Stats
Incident ID
530
Report Count
2
Incident Date
2019-07-11
Editors
Khoa Lam
Incident Reports
Reports Timeline
/cdn.vox-cdn.com/uploads/chorus_asset/file/13959620/acastro_190204_1777_privacy_0001.jpg)
/cdn.vox-cdn.com/uploads/chorus_asset/file/13959620/acastro_190204_1777_privacy_0001.jpg)
theverge.com · 2020
- View the original report at its source
- View the report at the Internet Archive
Researchers have discovered a “deepfake ecosystem” on the messaging app Telegram centered around bots that generate fake nudes on request. Users interacting with these bots say they’re mainly creating nudes of women they know using images t…
technologyreview.com · 2020
- View the original report at its source
- View the report at the Internet Archive
Within 24 hours, the Vice article had inspired such a backlash that the creators of the app quickly took it down. The DeepNude Twitter account announced that no other versions would be released, and no one else would get access to the techn…
Variants
A "variant" is an incident that shares the same causative factors, produces similar harms, and involves the same intelligent systems as a known AI incident. Rather than index variants as entirely separate incidents, we list variations of incidents under the first similar incident submitted to the database. Unlike other submission types to the incident database, variants are not required to have reporting in evidence external to the Incident Database. Learn more from the research paper.
unreviewed
Incident Date:
2023-08-03
Description of Incident Circumstances
Journalistic reporting on the circumstances of the incident to help inform people what happened, where, involving who, when, and why.
Researchers have discovered a “deepfake ecosystem” on the messaging app Telegram centered around bots that generate fake nudes on
Inputs / Outputs
The sequence of data inputs into the intelligent system and outputs produced by the system involved in the incident. For a chatbot, this will generally present a back and forth between a human and the chatbot's responses.
Raji
12345
Sekar
Similar Incidents
Did our AI mess up? Flag the unrelated incidents
Similar Incidents
Did our AI mess up? Flag the unrelated incidents