Epistemic integrity

Incidents Harmed By

Incident 59757 Report
Female Students at Westfield High School in New Jersey Reportedly Targeted with Deepfake Nudes

2023-10-20

In October 2023, alleged deepfake nude images of female students were created and shared at Westfield High School in New Jersey. One alleged implicated system in this incident is the Clothoff deepfake app. A victim, Francesca Mani, and her mother, Dorota, began advocating for stronger laws after the school’s response reportedly left perpetrators unaccountable. Since the incident, their advocacy has drawn national attention, leading to trips to Washington, D.C., and bipartisan backing for legislation targeting AI-generated nonconsensual content while calling attention to deficiencies in existing legal protections.

Incident 111841 Report
Ongoing Purported AI-Assisted Identity Fraud Enables Unauthorized Access to Western Companies by North Korean IT Workers

2021-01-01

North Korean operatives have reportedly used AI-generated identities to secure remote jobs or impersonate employers in order to infiltrate companies. These tactics allegedly support sanctions evasion through wage theft, credential exfiltration, and malware deployment. Workers reportedly use fake resumes, VPNs, and face-altering tools; some deploy malware like OtterCookie after embedding, while others lure targets via spoofed job interviews. AI systems are reportedly used to generate fake resumes, alter profile photos, and assist in real-time responses during video interviews.

Incident 79927 Report
Aledo High School Student Allegedly Generates and Distributes Deepfake Nudes of Seven Female Classmates

2023-10-15

In October 2023, an unnamed male student at Aledo High School outside of Fort Worth, Texas allegedly generated and distributed deepfake nude pictures of classmate Elliston Berry and six other female students in her friend group via social media. Berry's mother, Anna McAdams, spoke with Senators Ted Cruz and Amy Klobuchar, who consequently drafted the Tools to Address Known Exploitation by Immobilizing Technological Deepfakes on Websites and Networks (or TAKE IT DOWN) Act.

Incident 96827 Report
'Pravda' Network, Successor to 'Portal Kombat,' Allegedly Seeding AI Models with Kremlin Disinformation

2022-02-24

A purported Moscow-based disinformation network, Pravda, allegedly infiltrated AI models by flooding the internet with pro-Kremlin falsehoods. A NewsGuard audit found that 10 major AI chatbots repeated these narratives 33% of the time, citing Pravda sources as legitimate. The tactic, called "LLM grooming," manipulates AI training data to embed Russian propaganda. Pravda is part of Portal Kombat, a larger Russian disinformation network identified by VIGINUM in February 2024, but in operation since February 2022.

Incident 8917 Report
Purported AI Voice Scam Reportedly Targets Westchester Parents with Fake Kidnapping Ransom Calls

2025-01-08

Scammers reportedly used AI voice synthesis to mimic children's voices in fake kidnapping calls, allegedly demanding ransom payments from parents in the Peekskill School District of Westchester, New York. The synthetic voices were reportedly generated from social media voice samples.

Epistemic integrity

Incidents Harmed By

Incident 59757 ReportFemale Students at Westfield High School in New Jersey Reportedly Targeted with Deepfake Nudes

Incident 111841 ReportOngoing Purported AI-Assisted Identity Fraud Enables Unauthorized Access to Western Companies by North Korean IT Workers

Incident 79927 ReportAledo High School Student Allegedly Generates and Distributes Deepfake Nudes of Seven Female Classmates

Incident 96827 Report'Pravda' Network, Successor to 'Portal Kombat,' Allegedly Seeding AI Models with Kremlin Disinformation

Incidents implicated systems

Incident 8917 ReportPurported AI Voice Scam Reportedly Targets Westchester Parents with Fake Kidnapping Ransom Calls

Related Entities Related EntitiesOther entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.

Related Entities

New York City Department of Education

Incidents involved as both Developer and Deployer

Teachers

Incidents Harmed By

students

Incidents Harmed By

Incidents involved as Deployer

New York City students

Incidents Harmed By

New York City teachers

Incidents Harmed By

Educational communities

Incidents Harmed By

New York City teacher data reports

Incidents implicated systems

New York City value-added teacher-evaluation model

Incidents implicated systems

Lockport City School District

Incidents involved as Deployer

SN Technologies

Incidents involved as Developer

Black students

Incidents Harmed By

AEGIS

Incidents implicated systems

Facial recognition technology

Incidents implicated systems

Weapons detection system

Incidents implicated systems

Intensive Partnerships for Effective Teaching

Incidents involved as both Developer and Deployer

low-income minority students

Incidents Harmed By

Algorithmic teacher evaluation program

Incidents implicated systems

Intensive Partnerships for Effective Teaching teacher-evaluation system

Incidents implicated systems

Charlotte Mecklenburg School District

Incidents involved as Deployer

Evolv Technology

Incidents involved as Developer

teachers at Charlotte Mecklenburg Schools

Incidents Harmed By

students at Charlotte Mecklenburg Schools

Incidents Harmed By

security officers at Charlotte Mecklenburg Schools

Incidents Harmed By

School administrators at Charlotte Mecklenburg Schools

Incidents Harmed By

Parents of students at Charlotte Mecklenburg Schools

Incidents Harmed By

Evolv Express weapons detection system

Incidents implicated systems

Sudowrite

Incidents involved as Developer

Incidents implicated systems

OpenAI

Incidents involved as both Developer and Deployer

Incidents involved as Developer

OpenAI Playground

Incidents implicated systems

ChatGPT

Incidents implicated systems

GPT-3

Incidents implicated systems

Geisel School of Medicine

Incidents involved as Deployer

Geisel School of Medicine's Technology staff

Incidents involved as Developer

Canvas

Incident 59757 Report
Female Students at Westfield High School in New Jersey Reportedly Targeted with Deepfake Nudes

Incident 111841 Report
Ongoing Purported AI-Assisted Identity Fraud Enables Unauthorized Access to Western Companies by North Korean IT Workers

Incident 79927 Report
Aledo High School Student Allegedly Generates and Distributes Deepfake Nudes of Seven Female Classmates

Incident 96827 Report
'Pravda' Network, Successor to 'Portal Kombat,' Allegedly Seeding AI Models with Kremlin Disinformation

Incident 8917 Report
Purported AI Voice Scam Reportedly Targets Westchester Parents with Fake Kidnapping Ransom Calls

Related Entities