Epistemic integrity
Incidents Harmed By
Incident 59757 Report
Female Students at Westfield High School in New Jersey Reportedly Targeted with Deepfake Nudes
2023-10-20
In October 2023, alleged deepfake nude images of female students were created and shared at Westfield High School in New Jersey. One alleged implicated system in this incident is the Clothoff deepfake app. A victim, Francesca Mani, and her mother, Dorota, began advocating for stronger laws after the school’s response reportedly left perpetrators unaccountable. Since the incident, their advocacy has drawn national attention, leading to trips to Washington, D.C., and bipartisan backing for legislation targeting AI-generated nonconsensual content while calling attention to deficiencies in existing legal protections.
MoreIncident 111839 Report
Ongoing Purported AI-Assisted Identity Fraud Enables Unauthorized Access to Western Companies by North Korean IT Workers
2021-01-01
North Korean operatives have reportedly used AI-generated identities to secure remote jobs or impersonate employers in order to infiltrate companies. These tactics allegedly support sanctions evasion through wage theft, credential exfiltration, and malware deployment. Workers reportedly use fake resumes, VPNs, and face-altering tools; some deploy malware like OtterCookie after embedding, while others lure targets via spoofed job interviews. AI systems are reportedly used to generate fake resumes, alter profile photos, and assist in real-time responses during video interviews.
MoreIncident 96827 Report
'Pravda' Network, Successor to 'Portal Kombat,' Allegedly Seeding AI Models with Kremlin Disinformation
2022-02-24
A purported Moscow-based disinformation network, Pravda, allegedly infiltrated AI models by flooding the internet with pro-Kremlin falsehoods. A NewsGuard audit found that 10 major AI chatbots repeated these narratives 33% of the time, citing Pravda sources as legitimate. The tactic, called "LLM grooming," manipulates AI training data to embed Russian propaganda. Pravda is part of Portal Kombat, a larger Russian disinformation network identified by VIGINUM in February 2024, but in operation since February 2022.
MoreIncident 79926 Report
Aledo High School Student Allegedly Generates and Distributes Deepfake Nudes of Seven Female Classmates
2023-10-15
In October 2023, an unnamed male student at Aledo High School outside of Fort Worth, Texas allegedly generated and distributed deepfake nude pictures of classmate Elliston Berry and six other female students in her friend group via social media. Berry's mother, Anna McAdams, spoke with Senators Ted Cruz and Amy Klobuchar, who consequently drafted the Tools to Address Known Exploitation by Immobilizing Technological Deepfakes on Websites and Networks (or TAKE IT DOWN) Act.
MoreRelated Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
Related Entities
X (Twitter)
Incidents implicated systems
- Incident 54317 Reports
Purported AI-Generated Image of Explosion Near Pentagon Reportedly Triggers Brief Market Dip and Public Confusion
- Incident 10603 Reports
Institute for Strategic Dialogue Reports Russian-Aligned Operation Overload Using Purported AI-Generated Impersonations Across January to March 2025
Unknown deepfake technology developer
Incidents involved as Developer
- Incident 79926 Reports
Aledo High School Student Allegedly Generates and Distributes Deepfake Nudes of Seven Female Classmates
- Incident 114123 Reports
Purported AI Voice Cloning Used to Impersonate Secretary of State Marco Rubio
Incidents implicated systems
Unknown voice cloning technology developer
Incidents involved as Developer
- Incident 114123 Reports
Purported AI Voice Cloning Used to Impersonate Secretary of State Marco Rubio
- Incident 80510 Reports
Senator Ben Cardin Reportedly Received a Purported Deepfake Zoom Call Impersonating Former Ukrainian Foreign Minister Dmytro Kuleba
Incidents implicated systems
Unknown voice cloning technology
Incidents involved as Developer
Incidents implicated systems
Russian government
Incidents involved as both Developer and Deployer
Incidents involved as Deployer
Russian state media
Incidents involved as both Developer and Deployer
Incidents involved as Deployer
Unknown deepfake creator
Incidents involved as both Developer and Deployer
Incidents involved as Deployer
Donald Trump
Incidents Harmed By
- Incident 12232 Reports
Purportedly AI-Generated Deepfake Ads on Facebook Reportedly Impersonate Trump, Musk, Ocasio-Cortez, Warren, Sanders, and Leavitt to Promote Fraudulent Rebates
- Incident 6971 Report
Purported Deepfake Image Allegedly Circulating of Donald Trump with Underage Girl at Jeffrey Epstein's Private Island
Incidents involved as Deployer
Spamouflage
Incidents involved as Deployer
- Incident 7742 Reports
Covert AI Influence Operations Linked to Russia, China, Iran, and Israel, OpenAI Reports
- Incident 11291 Report
Purported AI-Generated Video Depicting Philippine President Ferdinand Marcos Jr. Using Drugs Shared by Rodrigo Duterte Supporters and Amplified by China-Linked Spamouflage
Storm-1516
Incidents involved as Deployer
- Incident 96827 Reports
'Pravda' Network, Successor to 'Portal Kombat,' Allegedly Seeding AI Models with Kremlin Disinformation
- Incident 9694 Reports
Russian Disinformation Campaign Allegedly Used Fake News Site 'KBSF-San Francisco News' and Deepfake Video to Falsely Accuse Kamala Harris of 2011 Hit-and-Run
John Mark Dougan
Incidents involved as both Developer and Deployer
Incidents involved as Deployer
Government of Russia
Incidents involved as both Developer and Deployer
Incidents involved as Deployer
xAI
Incidents involved as both Developer and Deployer
- Incident 11882 Reports
Multiple LLMs Reportedly Generated Responses Aligning with Purported CCP Censorship and Propaganda
- Incident 12051 Report
Multiple Generative AI Systems Reportedly Amplify False Information During Charlie Kirk Assassination Coverage
Incidents involved as Developer
Perplexity
Incidents involved as both Developer and Deployer
Incidents involved as Developer
Incidents implicated systems
Meta
Incidents involved as both Developer and Deployer
- Incident 12232 Reports
Purportedly AI-Generated Deepfake Ads on Facebook Reportedly Impersonate Trump, Musk, Ocasio-Cortez, Warren, Sanders, and Leavitt to Promote Fraudulent Rebates
- Incident 12682 Reports
Meta's Automated Ad and Targeting Systems Reportedly Enabled Large-Scale Fraud Revenue
Incidents involved as Developer
Incidents involved as both Developer and Deployer
- Incident 12513 Reports
Purportedly AI-Generated Hunting Regulation Errors Reportedly Lead to Idaho Citation and Multi-State Warnings from Wildlife Agencies
- Incident 11882 Reports
Multiple LLMs Reportedly Generated Responses Aligning with Purported CCP Censorship and Propaganda
Incidents involved as Developer
Journalism
Incidents Harmed By
- Incident 96827 Reports
'Pravda' Network, Successor to 'Portal Kombat,' Allegedly Seeding AI Models with Kremlin Disinformation
- Incident 9694 Reports
Russian Disinformation Campaign Allegedly Used Fake News Site 'KBSF-San Francisco News' and Deepfake Video to Falsely Accuse Kamala Harris of 2011 Hit-and-Run
Storm-1679
Incidents involved as Deployer
- Incident 10603 Reports
Institute for Strategic Dialogue Reports Russian-Aligned Operation Overload Using Purported AI-Generated Impersonations Across January to March 2025
- Incident 12021 Report
Russian Disinformation Campaign Reportedly Used AI-Generated Posts and Videos to Target 2025 Moldovan Parliamentary Elections
Russian-aligned actors
Incidents involved as Deployer
- Incident 10603 Reports
Institute for Strategic Dialogue Reports Russian-Aligned Operation Overload Using Purported AI-Generated Impersonations Across January to March 2025
- Incident 11681 Report
Purportedly AI-Generated Image of British Army Colonels Captured in Ukraine Reportedly Circulates in Russian Media
Matryoshka
Incidents involved as Deployer
- Incident 10603 Reports
Institute for Strategic Dialogue Reports Russian-Aligned Operation Overload Using Purported AI-Generated Impersonations Across January to March 2025
- Incident 12021 Report
Russian Disinformation Campaign Reportedly Used AI-Generated Posts and Videos to Target 2025 Moldovan Parliamentary Elections
Academics
Incidents Harmed By
- Incident 11935 Reports
Purportedly Taxpayer-Funded Deloitte Report for Australian Government Contains Alleged AI-Generated Citations and Fabricated Legal Quote
- Incident 10603 Reports
Institute for Strategic Dialogue Reports Russian-Aligned Operation Overload Using Purported AI-Generated Impersonations Across January to March 2025
Unknown disinformation actors targeting Royal Malaysia Police
Incidents involved as Deployer
YouTube
Incidents implicated systems
- Incident 11241 Report
Alleged Unauthorized Deepfake AI Clones of Ravish Kumar Used to Spread Purportedly Fabricated News on YouTube
- Incident 11291 Report
Purported AI-Generated Video Depicting Philippine President Ferdinand Marcos Jr. Using Drugs Shared by Rodrigo Duterte Supporters and Amplified by China-Linked Spamouflage
Unknown social media actors exploiting the Air India Flight 171 disaster
Incidents involved as Deployer
General public of Thailand
Incidents Harmed By
- Incident 11271 Report
Purported AI-Generated Audio Clip Allegedly Portrays Cambodian Senate President Hun Sen Raising Money for Conflict with Thailand
- Incident 12551 Report
Purported Deepfake Reportedly Circulated on Facebook Impersonating Thai PBS World Anchors and Business Figures to Solicit Investments
General public of the Philippines
Incidents Harmed By
- Incident 112813 Reports
Philippine Officials Reportedly Share Veo 3-Generated Video to Support Vice President Sara Duterte During Impeachment
- Incident 11291 Report
Purported AI-Generated Video Depicting Philippine President Ferdinand Marcos Jr. Using Drugs Shared by Rodrigo Duterte Supporters and Amplified by China-Linked Spamouflage
Legal integrity
Incidents Harmed By
- Incident 114526 Reports
MyPillow Defense Lawyers in Coomer v. Lindell Reportedly Sanctioned for Filing Court Document Allegedly Containing AI-Generated Legal Citations
- Incident 11384 Reports
South African Legal Team Reportedly Relied on Unverified ChatGPT Case Law in Johannesburg Body Corporate Defamation Matter
Judicial integrity
Incidents Harmed By
- Incident 114526 Reports
MyPillow Defense Lawyers in Coomer v. Lindell Reportedly Sanctioned for Filing Court Document Allegedly Containing AI-Generated Legal Citations
- Incident 11384 Reports
South African Legal Team Reportedly Relied on Unverified ChatGPT Case Law in Johannesburg Body Corporate Defamation Matter
Alexandria Ocasio-Cortez
Incidents Harmed By
- Incident 12232 Reports
Purportedly AI-Generated Deepfake Ads on Facebook Reportedly Impersonate Trump, Musk, Ocasio-Cortez, Warren, Sanders, and Leavitt to Promote Fraudulent Rebates
- Incident 11701 Report
Chris Cuomo Amplifies Reportedly Labeled Deepfake Video of Alexandria Ocasio-Cortez, Purportedly Contributing to Misleading Political Narrative
Incidents implicated systems
- Incident 12072 Reports
Purported AI-Generated Deepfake of Irish Fine Gael Presidential Candidate Heather Humphreys Used in Fake Investment Videos on Meta Platforms
- Incident 11701 Report
Chris Cuomo Amplifies Reportedly Labeled Deepfake Video of Alexandria Ocasio-Cortez, Purportedly Contributing to Misleading Political Narrative
Government of Australia
Incidents Harmed By
- Incident 11935 Reports
Purportedly Taxpayer-Funded Deloitte Report for Australian Government Contains Alleged AI-Generated Citations and Fabricated Legal Quote
- Incident 12751 Report
Purportedly AI-Enhanced Phishing Campaign Allegedly Impersonates Australian Government Services in Large-Scale Welfare Scam
General public of Australia
Incidents Harmed By
- Incident 11935 Reports
Purportedly Taxpayer-Funded Deloitte Report for Australian Government Contains Alleged AI-Generated Citations and Fabricated Legal Quote
- Incident 12291 Report
Gold Coast Man Reportedly Ordered to Pay $343,500 After Posting Purported Deepfake Pornographic Images of Australian Public Figures
Quantum AI
Incidents involved as Deployer
- Incident 12072 Reports
Purported AI-Generated Deepfake of Irish Fine Gael Presidential Candidate Heather Humphreys Used in Fake Investment Videos on Meta Platforms
- Incident 12601 Report
AI-Generated Deepfake of Andrew Forrest Used to Promote Fraudulent 'Quantum AI' Crypto Platform on Facebook
Incidents implicated systems
General public of Ireland
Incidents Harmed By
- Incident 12072 Reports
Purported AI-Generated Deepfake of Irish Fine Gael Presidential Candidate Heather Humphreys Used in Fake Investment Videos on Meta Platforms
- Incident 12582 Reports
Purported Deepfake Mimicking RTÉ Broadcast Falsely Announced Irish Presidential Candidate Catherine Connolly's Withdrawal
Chuck Schumer
Incidents Harmed By
- Incident 12312 Reports
Purported AI-Generated Deepfake Video Reportedly Depicts Senator Chuck Schumer Endorsing Government Shutdown in NRSC Campaign Ad
- Incident 12141 Report
Donald Trump Reportedly Posts Purported AI-Modified Video of Chuck Schumer and Hakeem Jeffries During U.S. Government Shutdown Talks
Unidentified Israeli government contractor under close supervision
Incidents involved as Deployer
Facebook users
Incidents Harmed By
- Incident 12232 Reports
Purportedly AI-Generated Deepfake Ads on Facebook Reportedly Impersonate Trump, Musk, Ocasio-Cortez, Warren, Sanders, and Leavitt to Promote Fraudulent Rebates
- Incident 12601 Report
AI-Generated Deepfake of Andrew Forrest Used to Promote Fraudulent 'Quantum AI' Crypto Platform on Facebook