Deepfake creators
Incidents impliqués en tant que développeur et déployeur
Incident 64112 Rapports
Nonconsensual Deepfake Porn of Bobbi Althoff Spreads Rapidly on X
2024-02-20
Nonconsensual deepfake pornography of Bobbi Althoff, which had been in circulation for six months, is reported to have suddenly gone viral on X, jumping from around 178,000 views to 6.5 million views over a matter of hours. In addition to the harm to Althoff, this incident also spotlights X's role in distributing AI-generated nonconsensual porn due to alleged lax moderation.
PlusIncident 6661 Rapport
Presidency of Moldova Reportedly Refutes Purported Deepfake Video Slandering President Maia Sandu
2023-12-29
A deepfake video reportedly depicting President Maia Sandu's image and voice was released in Moldova, allegedly portraying her in a negative light to sow division and undermine democratic institutions. This video reportedly appeared on Telegram and was linked to Russian disinformation efforts.
PlusIncident 7411 Rapport
Robin Williams's Voice Deepfaked Without Consent
2023-10-02
Zelda Williams, the daughter of the late Robin Williams, condemned the misuse of her father's voice in AI-generated productions, having cited some instances where his voice had been deepfaked, along with the potential for further misuse, as such instances do not involve consent.
PlusIncident 7821 Rapport
AI 'Nudify' Apps Used as Tools for Blackmail and Extortion
2024-09-09
AI 'nudify' apps are being used to generate hyperrealistic non-consensual nude photos of individuals, which are then exploited for extortion and harassment. These apps use generative AI to remove clothing from images and create convincing fakes, often distributed on platforms like Telegram. Victims are threatened or shamed using these AI-generated images, with little recourse for removal or legal action.
PlusIncidents involved as Developer
Incident 6513 Rapports
Students at a Beverly Hills Middle School Allegedly Created and Shared Deepfake Nudes of Their Classmates
2023-12-06
At Beverly Vista Middle School in Beverly Hills, California, students allegedly used AI to generate fake nude photos with their classmates' faces, prompting investigations by school officials and the police. The incident highlights the increasing misuse of generative AI among minors.
PlusIncident 7372 Rapports
Amandine Le Pen Deepfake Account Misleads Thousands on TikTok
2024-04-16
A TikTok account, "Amandine Le Pen," created using AI deepfake technology, impersonated a fictional niece of Marine Le Pen, amassing over 30,000 followers. The account spread pro-RN messages and solicited donations, misleading users and exploiting political influence. Visual inconsistencies revealed the deepfake, raising concerns about AI misuse for political manipulation, identity theft, and violation of personal rights, especially with similar accounts proliferating, such as "Lena Maréchal Lepen."
PlusIncident 6741 Rapport
Manipulated Media via AI Disinformation and Deepfakes in 2024 Elections Erode Trust Across More Than 50 Countries
2024-03-14
AI-driven election disinformation is escalating globally, leveraging easy-to-use generative AI tools to create convincing deepfakes that mislead voters. This shift has simplified the process for individuals to generate fake content, having already eroded trust in elections by undermining public trust and manipulating voter perceptions. Evidence has, for example, been documented in incidents across the U.S., Moldova, Slovakia, Bangladesh, and Taiwan.
PlusIncident 6871 Rapport
Deepfake Porn Sites Use Breeze Liu's Image Without Consent
2024-04-08
Porn sites are alleged to have used AI-generated images of Breeze Liu without her consent, leading to severe emotional distress. Liu discovered a video of herself on Pornhub, which was then deepfaked and spread across over 800 links. Despite efforts to remove the content, many sites refused to comply, perpetuating the violation and exploitation of her image.
PlusIncidents involved as Deployer
Incident 70136 Rapports
American Asylum Seeker John Mark Dougan in Russia Reportedly Spreads Disinformation via AI Tools and Fake News Network
2024-05-29
John Mark Dougan, a former Florida sheriff's deputy granted asylum in Russia, has been implicated in spreading disinformation. Utilizing AI tools like OpenAI's ChatGPT and DALL-E 3, Dougan created over 160 fake news sites, disseminating false narratives to millions worldwide. His actions align with Russian disinformation strategies targeting Western democracies. See also Incident 734.
PlusIncident 90318 Rapports
Northern Ireland MLA Cara Hunter Allegedly Targeted by Deepfake Pornography Ahead of May 2022 Assembly Election
2022-04-15
Sometime in April 2022, reportedly some weeks before the May 5, 2022 Northern Ireland Assembly election, Member of the Legislative Assembly Cara Hunter was targeted in a deepfake pornography incident. A fake video depicting her in explicit scenarios is reported to have circulated widely on WhatsApp. Law enforcement have as of yet been unable to trace the origins of the video, according to reports. Additionally, it is alleged that about six months after the initial incident, she was the target of at least 15 more AI-generated deepfakes depicting her likeness in underwear.
PlusIncident 95811 Rapports
Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material
2025-02-26
Europol’s Operation Cumberland uncovered a global network distributing AI-generated child sexual abuse material (CSAM). The operation has led to 25 arrests and 273 identified suspects across 19 countries. The AI-enabled abuse allows criminals to create exploitative content at scale with minimal expertise.
PlusIncident 8178 Rapports
Purportedly AI-Generated Images Reportedly Spread Misinformation During Hurricane Helene Response
2024-09-24
During Hurricane Helene (September 24-29, 2024), purportedly AI-generated images circulated on social media, reportedly misleading the public and hindering disaster response efforts. Reportedly fake images including animals stranded on rooftops and political figures in floodwaters added confusion and disrupted emergency management. The spread of these images allegedly exacerbated existing challenges, including power outages and communication failures, all of which led to complications providing accurate information to those in need.
PlusEntités liées
Autres entités liées au même incident. Par exemple, si le développeur d'un incident est cette entité mais que le responsable de la mise en œuvre est une autre entité, ils sont marqués comme entités liées.
Entités liées
Synthetic audio generation technology developers
Incidents involved as Developer
- Incident 12893 Report
Malta's Prime Minister Robert Abela Reportedly Deepfaked by a Ukrainian National in Cryptocurrency Fraud Targeting Local Residents
- Incident 15153 Report
Purportedly AI-Generated Airport Videos Reportedly Showed Kosovo Diaspora Voters Supporting Albin Kurti
Incidents implicated systems
Synthetic audio generation technology
Incidents involved as Developer
Incidents implicated systems
Image generation technology developers
Incidents involved as Developer
- Incident 8178 Report
Purportedly AI-Generated Images Reportedly Spread Misinformation During Hurricane Helene Response
- Incident 7543 Report
Female Politicians in the United Kingdom Reportedly Victimized by Purported Deepfake Pornography
Incidents implicated systems
Synthetic media generation technology developers
Incidents involved as Developer
- Incident 70136 Report
American Asylum Seeker John Mark Dougan in Russia Reportedly Spreads Disinformation via AI Tools and Fake News Network
- Incident 12893 Report
Malta's Prime Minister Robert Abela Reportedly Deepfaked by a Ukrainian National in Cryptocurrency Fraud Targeting Local Residents
Incidents implicated systems
Minors
Affecté par des incidents
- Incident 95811 Report
Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material
- Incident 12342 Report
Purported AI-Generated Explicit Deepfakes of Sydney High School Students Reportedly Circulated Online
Incidents involved as Deployer
Students
Affecté par des incidents
- Incident 12342 Report
Purported AI-Generated Explicit Deepfakes of Sydney High School Students Reportedly Circulated Online
- Incident 10141 Report
Students in Maltese Schools Reportedly Being Targeted by Deepfake Nudes
Incidents involved as Deployer
Unknown actor(s) creating deepfake nudes of Sydney high school students
Incidents involved as Deployer
Investors
Affecté par des incidents
- Incident 12893 Report
Malta's Prime Minister Robert Abela Reportedly Deepfaked by a Ukrainian National in Cryptocurrency Fraud Targeting Local Residents
- Incident 15251 Report
Purported Deepfake Video Reportedly Impersonated Former Mongolian Deputy Prime Minister Amarsaikhan Sainbuyan in Investment Scam
People seeking medical advice
Affecté par des incidents
- Incident 15182 Report
Kosovo Public Broadcaster RTK and Journalist Gëzim Bimbashi Were Reportedly AI-Impersonated in Alleged Fake Joint-Cure Scam Video
- Incident 15642 Report
Purported Deepfakes of Public Figures and Celebrities Reportedly Used to Market Honey-Based Supplements as Alzheimer's Treatments