Synthetic media generation technology

Incidents involved as Developer

インシデント 4945 Report
Female Celebrities' Faces Reportedly Shown in Sexually Suggestive Ads for Deepfake App

2023-03-05

Sexually suggestive videos featuring faces of female celebrities such as Emma Watson and Scarlett Johansson were reportedly rolled out as ads on social media for an app allowing users to create deepfakes.

もっと

インシデント 16483 Report
Hong Kong Man Reportedly Lost More Than HK$10 Million in WhatsApp Scam Using Purported AI-Generated Voice Impersonation of His Father

2026-07-29

A Hong Kong man reportedly lost more than HK$10 million after scammers hijacked his father's WhatsApp account and sent voice messages closely resembling his father's voice and speech. The victim allegedly made repeated transfers until his savings were depleted.

もっと

Incidents implicated systems

インシデント 59757 Report
Female Students at Westfield High School in New Jersey Reportedly Targeted with Deepfake Nudes

2023-10-20

In October 2023, alleged deepfake nude images of female students were created and shared at Westfield High School in New Jersey. One alleged implicated system in this incident is the Clothoff deepfake app. A victim, Francesca Mani, and her mother, Dorota, began advocating for stronger laws after the school’s response reportedly left perpetrators unaccountable. Since the incident, their advocacy has drawn national attention, leading to trips to Washington, D.C., and bipartisan backing for legislation targeting AI-generated nonconsensual content while calling attention to deficiencies in existing legal protections.

もっと

インシデント 70136 Report
American Asylum Seeker John Mark Dougan in Russia Reportedly Spreads Disinformation via AI Tools and Fake News Network

2024-05-29

John Mark Dougan, a former Florida sheriff's deputy granted asylum in Russia, has been implicated in spreading disinformation. Utilizing AI tools like OpenAI's ChatGPT and DALL-E 3, Dougan created over 160 fake news sites, disseminating false narratives to millions worldwide. His actions align with Russian disinformation strategies targeting Western democracies. See also Incident 734.

もっと

インシデント 165525 Report
Suno Allegedly Copied Copyrighted Music Without Permission to Train Its Generative AI Models

2024-06-24

Record labels and independent artists alleged that Suno copied copyrighted recordings without permission and used them to train its generative music models. Suno later acknowledged training on tens of millions of publicly accessible recordings while asserting fair use. Plaintiffs alleged the practice deprived rightsholders of licensing control and compensation and enabled competing AI-generated music.

もっと

インシデント 90123 Report
Yahoo Boys Allegedly Used Deepfake Technology to Impersonate Brad Pitt and Defraud French Woman of $850,000 in Romance Scam

2025-01-12

Three Nigerian "Yahoo Boys" scammers allegedly used AI-generated image manipulation tools, along with fake social media and WhatsApp accounts, to reportedly impersonate actor Brad Pitt and convince a French interior decorator, Anne, that she was in a romantic relationship with him. Over 18 months, they allegedly fabricated selfies and messages, reportedly leading Anne to divorce her husband and transfer $850,000 under the false pretense that Pitt needed money for kidney treatment while his accounts were frozen.

Synthetic media generation technology

Incidents involved as Developer

インシデント 4945 ReportFemale Celebrities' Faces Reportedly Shown in Sexually Suggestive Ads for Deepfake App

インシデント 16483 ReportHong Kong Man Reportedly Lost More Than HK$10 Million in WhatsApp Scam Using Purported AI-Generated Voice Impersonation of His Father

Incidents implicated systems

インシデント 59757 ReportFemale Students at Westfield High School in New Jersey Reportedly Targeted with Deepfake Nudes

インシデント 70136 ReportAmerican Asylum Seeker John Mark Dougan in Russia Reportedly Spreads Disinformation via AI Tools and Fake News Network

インシデント 165525 ReportSuno Allegedly Copied Copyrighted Music Without Permission to Train Its Generative AI Models

インシデント 90123 ReportYahoo Boys Allegedly Used Deepfake Technology to Impersonate Brad Pitt and Defraud French Woman of $850,000 in Romance Scam

関連団体

Synthetic media creators

Incidents involved as Deployer

Deepfake creators

Incidents involved as Developer

Incidents involved as Deployer