Deepfake creators
開発者と提供者の両方の立場で関わったインシデント
インシデント 64112 Report
Nonconsensual Deepfake Porn of Bobbi Althoff Spreads Rapidly on X
2024-02-20
Nonconsensual deepfake pornography of Bobbi Althoff, which had been in circulation for six months, is reported to have suddenly gone viral on X, jumping from around 178,000 views to 6.5 million views over a matter of hours. In addition to the harm to Althoff, this incident also spotlights X's role in distributing AI-generated nonconsensual porn due to alleged lax moderation.
もっとインシデント 6661 Report
Presidency of Moldova Reportedly Refutes Purported Deepfake Video Slandering President Maia Sandu
2023-12-29
A deepfake video reportedly depicting President Maia Sandu's image and voice was released in Moldova, allegedly portraying her in a negative light to sow division and undermine democratic institutions. This video reportedly appeared on Telegram and was linked to Russian disinformation efforts.
もっとインシデント 7411 Report
Robin Williams's Voice Deepfaked Without Consent
2023-10-02
Zelda Williams, the daughter of the late Robin Williams, condemned the misuse of her father's voice in AI-generated productions, having cited some instances where his voice had been deepfaked, along with the potential for further misuse, as such instances do not involve consent.
もっとインシデント 7821 Report
AI 'Nudify' Apps Used as Tools for Blackmail and Extortion
2024-09-09
AI 'nudify' apps are being used to generate hyperrealistic non-consensual nude photos of individuals, which are then exploited for extortion and harassment. These apps use generative AI to remove clothing from images and create convincing fakes, often distributed on platforms like Telegram. Victims are threatened or shamed using these AI-generated images, with little recourse for removal or legal action.
もっとIncidents involved as Developer
インシデント 6513 Report
Students at a Beverly Hills Middle School Allegedly Created and Shared Deepfake Nudes of Their Classmates
2023-12-06
At Beverly Vista Middle School in Beverly Hills, California, students allegedly used AI to generate fake nude photos with their classmates' faces, prompting investigations by school officials and the police. The incident highlights the increasing misuse of generative AI among minors.
もっとインシデント 7372 Report
Amandine Le Pen Deepfake Account Misleads Thousands on TikTok
2024-04-16
A TikTok account, "Amandine Le Pen," created using AI deepfake technology, impersonated a fictional niece of Marine Le Pen, amassing over 30,000 followers. The account spread pro-RN messages and solicited donations, misleading users and exploiting political influence. Visual inconsistencies revealed the deepfake, raising concerns about AI misuse for political manipulation, identity theft, and violation of personal rights, especially with similar accounts proliferating, such as "Lena Maréchal Lepen."
もっとインシデント 6741 Report
Manipulated Media via AI Disinformation and Deepfakes in 2024 Elections Erode Trust Across More Than 50 Countries
2024-03-14
AI-driven election disinformation is escalating globally, leveraging easy-to-use generative AI tools to create convincing deepfakes that mislead voters. This shift has simplified the process for individuals to generate fake content, having already eroded trust in elections by undermining public trust and manipulating voter perceptions. Evidence has, for example, been documented in incidents across the U.S., Moldova, Slovakia, Bangladesh, and Taiwan.
もっとインシデント 6871 Report
Deepfake Porn Sites Use Breeze Liu's Image Without Consent
2024-04-08
Porn sites are alleged to have used AI-generated images of Breeze Liu without her consent, leading to severe emotional distress. Liu discovered a video of herself on Pornhub, which was then deepfaked and spread across over 800 links. Despite efforts to remove the content, many sites refused to comply, perpetuating the violation and exploitation of her image.
もっとIncidents involved as Deployer
インシデント 70136 Report
American Asylum Seeker John Mark Dougan in Russia Reportedly Spreads Disinformation via AI Tools and Fake News Network
2024-05-29
John Mark Dougan, a former Florida sheriff's deputy granted asylum in Russia, has been implicated in spreading disinformation. Utilizing AI tools like OpenAI's ChatGPT and DALL-E 3, Dougan created over 160 fake news sites, disseminating false narratives to millions worldwide. His actions align with Russian disinformation strategies targeting Western democracies. See also Incident 734.
もっとインシデント 90318 Report
Northern Ireland MLA Cara Hunter Allegedly Targeted by Deepfake Pornography Ahead of May 2022 Assembly Election
2022-04-15
Sometime in April 2022, reportedly some weeks before the May 5, 2022 Northern Ireland Assembly election, Member of the Legislative Assembly Cara Hunter was targeted in a deepfake pornography incident. A fake video depicting her in explicit scenarios is reported to have circulated widely on WhatsApp. Law enforcement have as of yet been unable to trace the origins of the video, according to reports. Additionally, it is alleged that about six months after the initial incident, she was the target of at least 15 more AI-generated deepfakes depicting her likeness in underwear.
もっとインシデント 95811 Report
Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material
2025-02-26
Europol’s Operation Cumberland uncovered a global network distributing AI-generated child sexual abuse material (CSAM). The operation has led to 25 arrests and 273 identified suspects across 19 countries. The AI-enabled abuse allows criminals to create exploitative content at scale with minimal expertise.
もっとインシデント 8178 Report
Purportedly AI-Generated Images Reportedly Spread Misinformation During Hurricane Helene Response
2024-09-24
During Hurricane Helene (September 24-29, 2024), purportedly AI-generated images circulated on social media, reportedly misleading the public and hindering disaster response efforts. Reportedly fake images including animals stranded on rooftops and political figures in floodwaters added confusion and disrupted emergency management. The spread of these images allegedly exacerbated existing challenges, including power outages and communication failures, all of which led to complications providing accurate information to those in need.
もっと関連団体
同じインシデントに関連するその他のエンティティ。たとえば、インシデントの開発者がこのエンティティで、デプロイヤーが別のエンティティである場合、それらは関連エンティティとしてマークされます。
関連団体
Synthetic audio generation technology developers
Incidents involved as Developer
- インシデント 12893 レポート
Malta's Prime Minister Robert Abela Reportedly Deepfaked by a Ukrainian National in Cryptocurrency Fraud Targeting Local Residents
- インシデント 15153 レポート
Purportedly AI-Generated Airport Videos Reportedly Showed Kosovo Diaspora Voters Supporting Albin Kurti
Incidents implicated systems
Synthetic audio generation technology
Incidents involved as Developer
Incidents implicated systems
Image generation technology developers
Incidents involved as Developer
- インシデント 8178 レポート
Purportedly AI-Generated Images Reportedly Spread Misinformation During Hurricane Helene Response
- インシデント 7543 レポート
Female Politicians in the United Kingdom Reportedly Victimized by Purported Deepfake Pornography
Incidents implicated systems
Synthetic media generation technology developers
Incidents involved as Developer
- インシデント 70136 レポート
American Asylum Seeker John Mark Dougan in Russia Reportedly Spreads Disinformation via AI Tools and Fake News Network
- インシデント 12893 レポート
Malta's Prime Minister Robert Abela Reportedly Deepfaked by a Ukrainian National in Cryptocurrency Fraud Targeting Local Residents
Incidents implicated systems
Minors
影響を受けたインシデント
- インシデント 95811 レポート
Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material
- インシデント 12342 レポート
Purported AI-Generated Explicit Deepfakes of Sydney High School Students Reportedly Circulated Online
Incidents involved as Deployer
Students
影響を受けたインシデント
- インシデント 12342 レポート
Purported AI-Generated Explicit Deepfakes of Sydney High School Students Reportedly Circulated Online
- インシデント 10141 レポート
Students in Maltese Schools Reportedly Being Targeted by Deepfake Nudes