Deepfake creators
Incidents involved as both Developer and Deployer
Incident 64112 Report
Nonconsensual Deepfake Porn of Bobbi Althoff Spreads Rapidly on X
2024-02-20
Nonconsensual deepfake pornography of Bobbi Althoff, which had been in circulation for six months, is reported to have suddenly gone viral on X, jumping from around 178,000 views to 6.5 million views over a matter of hours. In addition to the harm to Althoff, this incident also spotlights X's role in distributing AI-generated nonconsensual porn due to alleged lax moderation.
MoreIncident 6661 Report
Presidency of Moldova Reportedly Refutes Purported Deepfake Video Slandering President Maia Sandu
2023-12-29
A deepfake video reportedly depicting President Maia Sandu's image and voice was released in Moldova, allegedly portraying her in a negative light to sow division and undermine democratic institutions. This video reportedly appeared on Telegram and was linked to Russian disinformation efforts.
MoreIncident 7411 Report
Robin Williams's Voice Deepfaked Without Consent
2023-10-02
Zelda Williams, the daughter of the late Robin Williams, condemned the misuse of her father's voice in AI-generated productions, having cited some instances where his voice had been deepfaked, along with the potential for further misuse, as such instances do not involve consent.
MoreIncident 7821 Report
AI 'Nudify' Apps Used as Tools for Blackmail and Extortion
2024-09-09
AI 'nudify' apps are being used to generate hyperrealistic non-consensual nude photos of individuals, which are then exploited for extortion and harassment. These apps use generative AI to remove clothing from images and create convincing fakes, often distributed on platforms like Telegram. Victims are threatened or shamed using these AI-generated images, with little recourse for removal or legal action.
MoreIncidents involved as Developer
Incident 6513 Report
Students at a Beverly Hills Middle School Allegedly Created and Shared Deepfake Nudes of Their Classmates
2023-12-06
At Beverly Vista Middle School in Beverly Hills, California, students allegedly used AI to generate fake nude photos with their classmates' faces, prompting investigations by school officials and the police. The incident highlights the increasing misuse of generative AI among minors.
MoreIncident 7372 Report
Amandine Le Pen Deepfake Account Misleads Thousands on TikTok
2024-04-16
A TikTok account, "Amandine Le Pen," created using AI deepfake technology, impersonated a fictional niece of Marine Le Pen, amassing over 30,000 followers. The account spread pro-RN messages and solicited donations, misleading users and exploiting political influence. Visual inconsistencies revealed the deepfake, raising concerns about AI misuse for political manipulation, identity theft, and violation of personal rights, especially with similar accounts proliferating, such as "Lena Maréchal Lepen."
MoreIncident 6741 Report
Manipulated Media via AI Disinformation and Deepfakes in 2024 Elections Erode Trust Across More Than 50 Countries
2024-03-14
AI-driven election disinformation is escalating globally, leveraging easy-to-use generative AI tools to create convincing deepfakes that mislead voters. This shift has simplified the process for individuals to generate fake content, having already eroded trust in elections by undermining public trust and manipulating voter perceptions. Evidence has, for example, been documented in incidents across the U.S., Moldova, Slovakia, Bangladesh, and Taiwan.
MoreIncident 6871 Report
Deepfake Porn Sites Use Breeze Liu's Image Without Consent
2024-04-08
Porn sites are alleged to have used AI-generated images of Breeze Liu without her consent, leading to severe emotional distress. Liu discovered a video of herself on Pornhub, which was then deepfaked and spread across over 800 links. Despite efforts to remove the content, many sites refused to comply, perpetuating the violation and exploitation of her image.
MoreIncidents involved as Deployer
Incident 70136 Report
American Asylum Seeker John Mark Dougan in Russia Reportedly Spreads Disinformation via AI Tools and Fake News Network
2024-05-29
John Mark Dougan, a former Florida sheriff's deputy granted asylum in Russia, has been implicated in spreading disinformation. Utilizing AI tools like OpenAI's ChatGPT and DALL-E 3, Dougan created over 160 fake news sites, disseminating false narratives to millions worldwide. His actions align with Russian disinformation strategies targeting Western democracies. See also Incident 734.
MoreIncident 90318 Report
Northern Ireland MLA Cara Hunter Allegedly Targeted by Deepfake Pornography Ahead of May 2022 Assembly Election
2022-04-15
Sometime in April 2022, reportedly some weeks before the May 5, 2022 Northern Ireland Assembly election, Member of the Legislative Assembly Cara Hunter was targeted in a deepfake pornography incident. A fake video depicting her in explicit scenarios is reported to have circulated widely on WhatsApp. Law enforcement have as of yet been unable to trace the origins of the video, according to reports. Additionally, it is alleged that about six months after the initial incident, she was the target of at least 15 more AI-generated deepfakes depicting her likeness in underwear.
MoreIncident 95811 Report
Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material
2025-02-26
Europol’s Operation Cumberland uncovered a global network distributing AI-generated child sexual abuse material (CSAM). The operation has led to 25 arrests and 273 identified suspects across 19 countries. The AI-enabled abuse allows criminals to create exploitative content at scale with minimal expertise.
MoreIncident 8178 Report
Purportedly AI-Generated Images Reportedly Spread Misinformation During Hurricane Helene Response
2024-09-24
During Hurricane Helene (September 24-29, 2024), purportedly AI-generated images circulated on social media, reportedly misleading the public and hindering disaster response efforts. Reportedly fake images including animals stranded on rooftops and political figures in floodwaters added confusion and disrupted emergency management. The spread of these images allegedly exacerbated existing challenges, including power outages and communication failures, all of which led to complications providing accurate information to those in need.
MoreRelated Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
Related Entities
Synthetic audio generation technology developers
Incidents involved as Developer
- Incident 12893 Reports
Malta's Prime Minister Robert Abela Reportedly Deepfaked by a Ukrainian National in Cryptocurrency Fraud Targeting Local Residents
- Incident 15153 Reports
Purportedly AI-Generated Airport Videos Reportedly Showed Kosovo Diaspora Voters Supporting Albin Kurti
Incidents implicated systems
Synthetic audio generation technology
Incidents involved as Developer
Incidents implicated systems
Image generation technology developers
Incidents involved as Developer
- Incident 8178 Reports
Purportedly AI-Generated Images Reportedly Spread Misinformation During Hurricane Helene Response
- Incident 7543 Reports
Female Politicians in the United Kingdom Reportedly Victimized by Purported Deepfake Pornography
Incidents implicated systems
Synthetic media generation technology developers
Incidents involved as Developer
- Incident 70136 Reports
American Asylum Seeker John Mark Dougan in Russia Reportedly Spreads Disinformation via AI Tools and Fake News Network
- Incident 12893 Reports
Malta's Prime Minister Robert Abela Reportedly Deepfaked by a Ukrainian National in Cryptocurrency Fraud Targeting Local Residents
Incidents implicated systems
Minors
Incidents Harmed By
- Incident 95811 Reports
Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material
- Incident 12342 Reports
Purported AI-Generated Explicit Deepfakes of Sydney High School Students Reportedly Circulated Online
Incidents involved as Deployer
Synthetic video generation technology developers
Incidents involved as Developer
- Incident 15642 Reports
Purported Deepfakes of Public Figures and Celebrities Reportedly Used to Market Honey-Based Supplements as Alzheimer's Treatments
- Incident 15251 Report
Purported Deepfake Video Reportedly Impersonated Former Mongolian Deputy Prime Minister Amarsaikhan Sainbuyan in Investment Scam
Synthetic video generation technology
Incidents implicated systems
- Incident 15642 Reports
Purported Deepfakes of Public Figures and Celebrities Reportedly Used to Market Honey-Based Supplements as Alzheimer's Treatments
- Incident 15251 Report
Purported Deepfake Video Reportedly Impersonated Former Mongolian Deputy Prime Minister Amarsaikhan Sainbuyan in Investment Scam
Students
Incidents Harmed By
- Incident 12342 Reports
Purported AI-Generated Explicit Deepfakes of Sydney High School Students Reportedly Circulated Online
- Incident 10141 Report
Students in Maltese Schools Reportedly Being Targeted by Deepfake Nudes
Incidents involved as Deployer
Unknown actor(s) creating deepfake nudes of Sydney high school students
Incidents involved as Deployer
Investors
Incidents Harmed By
- Incident 12893 Reports
Malta's Prime Minister Robert Abela Reportedly Deepfaked by a Ukrainian National in Cryptocurrency Fraud Targeting Local Residents
- Incident 15251 Report
Purported Deepfake Video Reportedly Impersonated Former Mongolian Deputy Prime Minister Amarsaikhan Sainbuyan in Investment Scam
People seeking medical advice
Incidents Harmed By
- Incident 15182 Reports
Kosovo Public Broadcaster RTK and Journalist Gëzim Bimbashi Were Reportedly AI-Impersonated in Alleged Fake Joint-Cure Scam Video
- Incident 15642 Reports
Purported Deepfakes of Public Figures and Celebrities Reportedly Used to Market Honey-Based Supplements as Alzheimer's Treatments