Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse

Incident 597: Female Students at Westfield High School in New Jersey Reportedly Targeted with Deepfake Nudes

Responded
Description: In October 2023, alleged deepfake nude images of female students were created and shared at Westfield High School in New Jersey. One alleged implicated system in this incident is the Clothoff deepfake app. A victim, Francesca Mani, and her mother, Dorota, began advocating for stronger laws after the school’s response reportedly left perpetrators unaccountable. Since the incident, their advocacy has drawn national attention, leading to trips to Washington, D.C., and bipartisan backing for legislation targeting AI-generated nonconsensual content while calling attention to deficiencies in existing legal protections.
Editor Notes: See also: Incident 799: Aledo High School Student Generates and Distributes Deepfake Nudes of Seven Female Classmates. This incident is similar in both its timing and its role in driving advocacy against the misuse of deepfake technology for nonconsensual abuse.

Tools

New ReportNew ReportNew ResponseNew ResponseDiscoverDiscoverView HistoryView History

Entities

View all entities
Alleged: Developers of Clothoff developed an AI system deployed by Unnamed male students, which harmed Unnamed female students and Francesca Mani.
Alleged implicated AI system: Clothoff

Incident Stats

Incident ID
597
Report Count
57
Incident Date
2023-10-20
Editors
Daniel Atherton
Applied Taxonomies
MIT

MIT Taxonomy Classifications

Machine-Classified
Taxonomy Details

Risk Subdomain

A further 23 subdomains create an accessible and understandable classification of hazards and harms associated with AI
 

4.3. Fraud, scams, and targeted manipulation

Risk Domain

The Domain Taxonomy of AI Risks classifies risks into seven AI risk domains: (1) Discrimination & toxicity, (2) Privacy & security, (3) Misinformation, (4) Malicious actors & misuse, (5) Human-computer interaction, (6) Socioeconomic & environmental harms, and (7) AI system safety, failures & limitations.
 
  1. Malicious Actors & Misuse

Entity

Which, if any, entity is presented as the main cause of the risk
 

Human

Timing

The stage in the AI lifecycle at which the risk is presented as occurring
 

Post-deployment

Intent

Whether the risk is presented as occurring as an expected or unexpected outcome from pursuing a goal
 

Intentional

Incident Reports

Reports Timeline

+1
Westfield High School Principal Addresses Parents After Word of Fake Photos
+36
Letter: Was Your Child a Victim? WHS Parent Wants to Connect - Response
+2
For teen girls victimized by ‘deepfake’ nudes, there is little recourse
+1
Sharing Fake Nude Images Could Become a Federal Crime Under Proposed Law - Response
It’s not just Taylor Swift ‘nudes’: Millions of teen girls victimized as classmates turn them into deepfake porn+1
Lawsuit Criticizes Lack of Charges in Westfield Fake Nude Pix Case
+1
‘Staying silent? Not an option’: family takes fight against deepfake nudes to Washington
Teen Girls Confront an Epidemic of Deepfake Nudes in Schools - ResponseBipartisan push to remove and ban AI deepfake pornography+1
TIME100 AI 2024, Francesca Mani: Anti-deepfake activist
Bold NJ teen makes Time top 100 in AI for fight against deepfakesDeepfake crisis at schools: 'I refuse to wear victim's badge'+1
What happened to Francesca Mani? Artificial Intelligence nudify incident explored as anti-deepfake activist fights for change
What to know about deepfakes bill backed by Melania Trump - Response
Westfield High School Principal Addresses Parents After Word of Fake Photos

Westfield High School Principal Addresses Parents After Word of Fake Photos

tapinto.net

Letter: Was Your Child a Victim? WHS Parent Wants to Connect

Letter: Was Your Child a Victim? WHS Parent Wants to Connect

tapinto.net

Fake Nudes of Real Students Cause an Uproar at a New Jersey High School

Fake Nudes of Real Students Cause an Uproar at a New Jersey High School

wsj.com

New Jersey high school students accused of making AI-generated pornographic images of classmates

New Jersey high school students accused of making AI-generated pornographic images of classmates

cbsnews.com

Westfield High School student accused of creating AI nude images of classmates

Westfield High School student accused of creating AI nude images of classmates

fox5ny.com

AI-generated nude images of girls at NJ high school trigger police probe: ‘I am terrified’

AI-generated nude images of girls at NJ high school trigger police probe: ‘I am terrified’

nypost.com

AI Made Porn Of Westfield HS Students Prompts Investigation

AI Made Porn Of Westfield HS Students Prompts Investigation

patch.com

Teen boys accused of creating AI deepfake nudes of female classmates

Teen boys accused of creating AI deepfake nudes of female classmates

independent.co.uk

Westfield Parents Demand Action After Learning About AI Nude Photos

Westfield Parents Demand Action After Learning About AI Nude Photos

tapinto.net

Teen boys use AI to make fake nudes of classmates, sparking police probe

Teen boys use AI to make fake nudes of classmates, sparking police probe

arstechnica.com

New Jersey high school boy caught sharing AI-generated NUDES

New Jersey high school boy caught sharing AI-generated NUDES

dailymail.co.uk

AI-generated nude images of female students at NJ high school rouse community outcry, police investigation

AI-generated nude images of female students at NJ high school rouse community outcry, police investigation

audacy.com

What to Do About Fake Nude Photos and the Horrors of A.I.

What to Do About Fake Nude Photos and the Horrors of A.I.

dailycitizen.focusonthefamily.com

Police Investigating AI-Generated Nude Photo Ring of Girls at New Jersey High School: Report

Police Investigating AI-Generated Nude Photo Ring of Girls at New Jersey High School: Report

themessenger.com

Teens exploited by fake nudes illustrate threat of unregulated AI

Teens exploited by fake nudes illustrate threat of unregulated AI

axios.com

Shocking deepfake porn images at Westfield, NJ, school

Shocking deepfake porn images at Westfield, NJ, school

nj1015.com

High schooler allegedly used real photos to make pornographic 'deepfakes' of female classmates

High schooler allegedly used real photos to make pornographic 'deepfakes' of female classmates

lawandcrime.com

High School Students Use AI to Make Deepfake Nude Photos of Classmates

High School Students Use AI to Make Deepfake Nude Photos of Classmates

petapixel.com

New Jersey high school 'deepfake' incident shows lack of legal recourse for victims

New Jersey high school 'deepfake' incident shows lack of legal recourse for victims

washingtonexaminer.com

High schoolers accused of making AI-generated pornographic images of their classmates

High schoolers accused of making AI-generated pornographic images of their classmates

wsaz.com

NJ Teens Allegedly Distributed 'Deepfake' Nude Photos of Female Classmates

NJ Teens Allegedly Distributed 'Deepfake' Nude Photos of Female Classmates

cafemom.com

AI-made nude photos circulating in New Jersey school spark investigation

AI-made nude photos circulating in New Jersey school spark investigation

newsnationnow.com

Police Investigating AI-Generated Nudes of New Jersey High Schoolers

Police Investigating AI-Generated Nudes of New Jersey High Schoolers

futurism.com

A New Problem With AI: Deepfake Nude Photos of Girls

A New Problem With AI: Deepfake Nude Photos of Girls

newser.com

Teenagers making AI-Generated Deep Fake Nudes of classmates Prompts Police Investigation

Teenagers making AI-Generated Deep Fake Nudes of classmates Prompts Police Investigation

timesnownews.com

New Jersey high school rocked as students share 'deep fake' nudes of real girls

New Jersey high school rocked as students share 'deep fake' nudes of real girls

readlion.com

High schooler calls for AI regulations after manipulated pornographic images of her and others shared online

High schooler calls for AI regulations after manipulated pornographic images of her and others shared online

cnn.com

Teens are terrorizing classmates with fake nudes

Teens are terrorizing classmates with fake nudes

morningbrew.com

High School Students Under Investigation for AI-Generated Deepfake Pics of Classmates

High School Students Under Investigation for AI-Generated Deepfake Pics of Classmates

shorenewsnetwork.com

U.S. high schooler accused of using AI to create nude images of classmates - National

U.S. high schooler accused of using AI to create nude images of classmates - National

globalnews.ca

Op-Ed: Before it’s Too Late — Deepfake AI Porn and Youth Mental Health

Op-Ed: Before it’s Too Late — Deepfake AI Porn and Youth Mental Health

tapinto.net

Westfield Student Accused Of Making AI Porn Returns To School: Reports

Westfield Student Accused Of Making AI Porn Returns To School: Reports

patch.com

Students are sharing AI-generated fake nudes of classmates—and there's no US federal law to stop them

Students are sharing AI-generated fake nudes of classmates—and there's no US federal law to stop them

qz.com

Teen and mother speak out after alleged AI-generated photos sent around high school

Teen and mother speak out after alleged AI-generated photos sent around high school

abcnews.go.com

New Jersey High Schoolers Spread ‘Deepfake’ Nudes of Female Students

New Jersey High Schoolers Spread ‘Deepfake’ Nudes of Female Students

wehavekids.com

High school students accused of circulating AI-generated explicit photos of classmates

High school students accused of circulating AI-generated explicit photos of classmates

local12.com

A loophole makes it hard to punish these despicable AI-generated nude photos

A loophole makes it hard to punish these despicable AI-generated nude photos

msnbc.com

14-Year-Old Becomes A Victim Of Deepfake AI-Generated Porn

14-Year-Old Becomes A Victim Of Deepfake AI-Generated Porn

blackenterprise.com

For teen girls victimized by ‘deepfake’ nudes, there is little recourse

For teen girls victimized by ‘deepfake’ nudes, there is little recourse

nbcnews.com

Teen girls are being victimized by deepfake nudes. One family is pushing for more protections

Teen girls are being victimized by deepfake nudes. One family is pushing for more protections

apnews.com

Deepfake nude images of teen girls prompt action from parents, lawmakers: "AI pandemic"

Deepfake nude images of teen girls prompt action from parents, lawmakers: "AI pandemic"

cbsnews.com

Sharing Fake Nude Images Could Become a Federal Crime Under Proposed Law

Sharing Fake Nude Images Could Become a Federal Crime Under Proposed Law

wsj.com

Teen deepfake victim pushes for federal law targeting AI-generated explicit content

Teen deepfake victim pushes for federal law targeting AI-generated explicit content

nbcnews.com

It’s not just Taylor Swift ‘nudes’: Millions of teen girls victimized as classmates turn them into deepfake porn

It’s not just Taylor Swift ‘nudes’: Millions of teen girls victimized as classmates turn them into deepfake porn

nypost.com

Lawsuit Criticizes Lack of Charges in Westfield Fake Nude Pix Case

Lawsuit Criticizes Lack of Charges in Westfield Fake Nude Pix Case

tapinto.net

Westfield Teen Attends State of the Union Address as Guest of Congressman Kean

Westfield Teen Attends State of the Union Address as Guest of Congressman Kean

tapinto.net

‘Staying silent? Not an option’: family takes fight against deepfake nudes to Washington

‘Staying silent? Not an option’: family takes fight against deepfake nudes to Washington

theguardian.com

Teen Boys Deepfaked Her Daughter. Then The School Made It Worse, One Mom Says.

Teen Boys Deepfaked Her Daughter. Then The School Made It Worse, One Mom Says.

forbes.com

Teen Girls Confront an Epidemic of Deepfake Nudes in Schools

Teen Girls Confront an Epidemic of Deepfake Nudes in Schools

nytimes.com

Bipartisan push to remove and ban AI deepfake pornography

Bipartisan push to remove and ban AI deepfake pornography

foxnews.com

TIME100 AI 2024, Francesca Mani: Anti-deepfake activist

TIME100 AI 2024, Francesca Mani: Anti-deepfake activist

time.com

Westfield Teen Named to TIME’s List of 100 Most Influential People in AI

Westfield Teen Named to TIME’s List of 100 Most Influential People in AI

tapinto.net

Bold NJ teen makes Time top 100 in AI for fight against deepfakes

Bold NJ teen makes Time top 100 in AI for fight against deepfakes

nj1015.com

Deepfake crisis at schools: 'I refuse to wear victim's badge'

Deepfake crisis at schools: 'I refuse to wear victim's badge'

koreatimes.co.kr

What happened to Francesca Mani? Artificial Intelligence nudify incident explored as anti-deepfake activist fights for change

What happened to Francesca Mani? Artificial Intelligence nudify incident explored as anti-deepfake activist fights for change

soapcentral.com

A teenager created an AI nude of his female classmate and circulated it on Snapchat – he was suspended from school for one day

A teenager created an AI nude of his female classmate and circulated it on Snapchat – he was suspended from school for one day

digitalcameraworld.com

What to know about deepfakes bill backed by Melania Trump

What to know about deepfakes bill backed by Melania Trump

axios.com

Westfield High School Principal Addresses Parents After Word of Fake Photos
tapinto.net · 2023

WESTFIELD, NJ --- Westfield High School Principal Mary Asfendis sent a letter to parents Friday afternoon about what she said was "widespread misinformation" that resulted in "significant worry and concern amongst the student body of Westfi…

Letter: Was Your Child a Victim? WHS Parent Wants to Connect
tapinto.net · 2023
Dorota Wieczorek post-incident response

"AI pornographic images were circulated of your 14-year-old daughter," the WHS principal informed me on Friday. "This has been confirmed by four people, but not to worry, the person who did it is gone."

"We have it under control, the images…

Fake Nudes of Real Students Cause an Uproar at a New Jersey High School
wsj.com · 2023

When girls at Westfield High School in New Jersey found out boys were sharing nude photos of them in group chats, they were shocked, and not only because it was an invasion of privacy. The images weren't real.

Students said one or more clas…

New Jersey high school students accused of making AI-generated pornographic images of classmates
cbsnews.com · 2023

WESTFIELD, N.J. -- Parents and students at Westfield High School in New Jersey say students used an app or website to make AI-generated pornographic images of their classmates.

Parents recently got an email from the principal, warning of th…

Westfield High School student accused of creating AI nude images of classmates
fox5ny.com · 2023

WESTFIELD, N.J. - Reports indicate that male students at Westfield High School utilized Artificial Intelligence to produce explicit images of female students using their original photos during the summer.

"We were so mad. A lot of girls wer…

AI-generated nude images of girls at NJ high school trigger police probe: ‘I am terrified’
nypost.com · 2023
Shannon Thaler post-incident response

AI-generated pornographic images of female students at a New Jersey high school were circulated by male classmates, sparking parent uproar and a police investigation, according a report.

Students at Westfield High School — located in Westfi…

AI Made Porn Of Westfield HS Students Prompts Investigation
patch.com · 2023
Megan VerHelst post-incident response

WESTFIELD, NJ — Students at Westfield High School made and distributed fake pornographic images of other female students at the school, sparking concern among some parents and prompting officials to investigate the claims, according to offi…

Teen boys accused of creating AI deepfake nudes of female classmates
independent.co.uk · 2023

An investigation is underway after teen girls at a New Jersey high school discovered that their male classmates had used artificial intelligence websites to create fake nudes of them, which the teen boys then shared and circulated.

Parents …

Westfield Parents Demand Action After Learning About AI Nude Photos
tapinto.net · 2023
Jackie Lieberman post-incident response

WESTFIELD, NJ --- Westfield parents, students and community members are demanding action after word got out at Westfield High School that at least one boy from the school had created and shared pornographic images using photos of the faces …

Teen boys use AI to make fake nudes of classmates, sparking police probe
arstechnica.com · 2023

This October, boys at Westfield High School in New Jersey started acting "weird," the Wall Street Journal reported. It took four days before the school found out that the boys had been using AI image generators to create and share fake nude…

New Jersey high school boy caught sharing AI-generated NUDES
dailymail.co.uk · 2023

A New Jersey high school has been plunged into crisis after male students were caught sharing AI-generated nudes of their female classmates. 

Some male students in the sophomore class of Westfield High School in New Jersey used an AI-powere…

AI-generated nude images of female students at NJ high school rouse community outcry, police investigation
audacy.com · 2023
Erin White, Mack Rosenberg post-incident response

NEW YORK (1010 WINS/WCBS 880) – Boys from New Jersey’s Westfield High School shared fake, AI-generated nude photos of female classmates in group chats over the summer, 1010 WINS/WCBS 880 confirmed.

According to students, one or more of thei…

What to Do About Fake Nude Photos and the Horrors of A.I.
dailycitizen.focusonthefamily.com · 2023
Paul Batura post-incident response

Westfield High School in Westfield, New Jersey, dates back to 1864, but it’s been a fixture on Dorian Road since 1951. With nearly 2000 students enrolled today, the district has dealt with all kinds of issues over the years, but perhaps few…

Police Investigating AI-Generated Nude Photo Ring of Girls at New Jersey High School: Report
themessenger.com · 2023
Mark Moore post-incident response

AI-generated pornographic photos of female students at a New Jersey high school and distributed among their male classmates has sparked outrage among parents and school officials and prompted an investigation by police, according to a repor…

Teens exploited by fake nudes illustrate threat of unregulated AI
axios.com · 2023

A phone, a few photos and artificial intelligence have stirred controversy and shattered the privacy of several teens at a New Jersey high school after they learned that nude images of them --- created via AI --- were circulated in group ch…

Shocking deepfake porn images at Westfield, NJ, school
nj1015.com · 2023

The dangers of artificial intelligence technology have been brought home in Westfield after fake pornographic images of female students were circulated at the local high school.

The images were created using real photos from social media on…

High schooler allegedly used real photos to make pornographic 'deepfakes' of female classmates
lawandcrime.com · 2023

Students at a New Jersey high school are terrified after learning that one of their classmates allegedly used AI to create sexually explicit images of them without their permission.

Westfield High School student Francesca Mani said that she…

High School Students Use AI to Make Deepfake Nude Photos of Classmates
petapixel.com · 2023

Teen boys used artificial intelligence (AI) to make deepfake nude photographs of their female classmates at a high school in the U.S.

An investigation is now underway after teenage girls at Westfield High School in Westfield, New Jersey, di…

New Jersey high school 'deepfake' incident shows lack of legal recourse for victims
washingtonexaminer.com · 2023

A high-profile incident in which high school students shared artificial intelligence-generated pornographic images of underage classmates has drawn attention to the lack of legal resources for victims of such "deepfakes."

Although deepfakes…

High schoolers accused of making AI-generated pornographic images of their classmates
wsaz.com · 2023

WESTFIELD, N.J. (WCBS) – Some New Jersey high school students are accused of sharing AI-generated nude photos of their classmates.

The incident happened over the summer but was just recently brought to the attention of administrators at Wes…

NJ Teens Allegedly Distributed 'Deepfake' Nude Photos of Female Classmates
cafemom.com · 2023

A school community in New Jersey was shocked when images of nude female students began circulating at Westfield High School. Even more shocking, someone had actually created pornographic photos using AI images. Sophomore boys allegedly acte…

AI-made nude photos circulating in New Jersey school spark investigation
newsnationnow.com · 2023
Nick Smith post-incident response

(NewsNation) — A nude photo controversy has a New Jersey community demanding answers.

High school students say they were stunned to learn inappropriate photos of them were circulating among their classmates — and that the images were comple…

Police Investigating AI-Generated Nudes of New Jersey High Schoolers
futurism.com · 2023
Noor Al-Sibai post-incident response

After AI-generated nudes of teen girls began circulating in a New Jersey high school, neither parents, school officials nor even local law enforcement have been able to figure out how to deal with it.

As the Wall Street Journal reports, gir…

A New Problem With AI: Deepfake Nude Photos of Girls
newser.com · 2023
Arden Dier post-incident response

The sharing of explicit AI-generated images of high school students has triggered an uproar in an affluent New York City suburb and left the teens, parents, school, and police wondering how they can address the violations given what the Wal…

Teenagers making AI-Generated Deep Fake Nudes of classmates Prompts Police Investigation
timesnownews.com · 2023
TN Tech Desk post-incident response

High School AI Scandal Prompts Police Investigation and Calls for Legal Reform

KEY HIGHLIGHTS

  • AI-generated fake nudes at a New Jersey high school trigger police investigation and legal action.

  • Students and faculty at Westfield High advo…

New Jersey high school rocked as students share 'deep fake' nudes of real girls
readlion.com · 2023

(Daily Caller News Foundation) – Girls at Westfield High School in New Jersey were left shocked when they discovered boys were circulating fake nude photos of them, according to a Thursday report from The Wall Street Journal (WSJ).

The inci…

High schooler calls for AI regulations after manipulated pornographic images of her and others shared online
cnn.com · 2023
Skylar Harris, Artemis Moshtaghian post-incident response

A student at a New Jersey high school is calling for federal legislation to address AI generated pornographic images after she says photos of her and other female classmates were manipulated and possibly shared online over the summer.

Westf…

Teens are terrorizing classmates with fake nudes
morningbrew.com · 2023

Deepfake porn is running rampant, and a New Jersey high school is one of the latest epicenters.

Police are investigating after boys at Westfield High School circulated AI-generated images that showed the faces of their female classmates on …

High School Students Under Investigation for AI-Generated Deepfake Pics of Classmates
shorenewsnetwork.com · 2023
Charlie Dwyer post-incident response

WESTFIELD, NJ — A group of Westfield High School students are the subject of an ongoing investigation after allegations surfaced of them using artificial intelligence to create and distribute pornographic images depicting peers. The princip…

U.S. high schooler accused of using AI to create nude images of classmates - National
globalnews.ca · 2023

Parents and students of Westfield High in New Jersey are speaking out after a male student or students allegedly used an AI generator to create fake nude images using the faces of female classmates and distributed them in a group chat.

Fran…

Op-Ed: Before it’s Too Late — Deepfake AI Porn and Youth Mental Health
tapinto.net · 2023
Alessandra Kellermann post-incident response

Alessandra Kellermann is a mental health counselor, behavior specialist and owner of Gentle Insight, LLC.

Before we lose another student to suicide, let's face the mental health crisis and issues as they arise, head on, without fear. 

As a …

Westfield Student Accused Of Making AI Porn Returns To School: Reports
patch.com · 2023

WESTFIELD, NJ — A Westfield High School student accused of using artificial intelligence to make fake pornographic images of female students at the school was suspended but has since returned to school, one of the victims and her mother tol…

Students are sharing AI-generated fake nudes of classmates—and there's no US federal law to stop them
qz.com · 2023

A New Jersey high school has been rocked by scandal after male students reportedly used AI to create fake nude photos of female students.

Last month, some teen girls at Westfield High School learned that fake nude images of them had been ci…

Teen and mother speak out after alleged AI-generated photos sent around high school
abcnews.go.com · 2023

A teen girl and her mother are speaking out after a high school student allegedly used artificial intelligence to create nude images of her and other girls, which were then shared with a group of classmates.

Francesca Mani, 14, learned abou…

New Jersey High Schoolers Spread ‘Deepfake’ Nudes of Female Students
wehavekids.com · 2023

School officials at Westfield High School in Westfield, New Jersey are trying to figure out who was behind "deepfake" photos meant to look like nude photos of female students. The AI-generated images were passed around by boys at the high s…

High school students accused of circulating AI-generated explicit photos of classmates
local12.com · 2023

WESTFIELD, N.J. (WCBS/CNN/CNN Newsource/WKRC) - High school students were accused of circulating AI-generated explicit photos of their classmates.

The incident happened over the summer in Westfield, New Jersey, but was only recently brought…

A loophole makes it hard to punish these despicable AI-generated nude photos
msnbc.com · 2023
Frank Figliuzzi post-incident response

Last week, an undisclosed number of girls at a New Jersey high school learned that one or more students at their school had used an artificial intelligence tool to generate what appeared to be nude images of them. Worse, those images, which…

14-Year-Old Becomes A Victim Of Deepfake AI-Generated Porn
blackenterprise.com · 2023
Stacy Jackson post-incident response

A New Jersey Westfield High School student, Francesca Mani, has come forward with her mother, Dorota, to address AI-generated pornographic images that she says were manipulated and shared of her and other female classmates over the summer.

…
For teen girls victimized by ‘deepfake’ nudes, there is little recourse
nbcnews.com · 2023

Teenage girls in the U.S. who are increasingly being targeted or threatened with fake nude photos created with artificial intelligence or other tools have limited ways to seek accountability or recourse, as schools and state legislatures st…

Teen girls are being victimized by deepfake nudes. One family is pushing for more protections
apnews.com · 2023
Haleluya Hadero post-incident response

A mother and her 14-year-old daughter are advocating for better protections for victims after AI-generated nude images of the teen and other female classmates were circulated at a high school in New Jersey.

Meanwhile, on the other side of t…

Deepfake nude images of teen girls prompt action from parents, lawmakers: "AI pandemic"
cbsnews.com · 2023
CBS News post-incident response

A mother and her 14-year-old daughter are advocating for better protections for victims after AI-generated nude images of the teen and other female classmates were circulated at a high school in New Jersey.

Meanwhile, on the other side of t…

Sharing Fake Nude Images Could Become a Federal Crime Under Proposed Law
wsj.com · 2024
Julie Jargon post-incident response

It could eventually be a federal crime to share digitally-altered nude images of real people.

Rep. Joseph Morelle (D., N.Y.) on Tuesday re-proposed the "Preventing Deepfakes of Intimate Images Act," which would outlaw the nonconsensual shar…

Teen deepfake victim pushes for federal law targeting AI-generated explicit content
nbcnews.com · 2024
Kat Tenbarge post-incident response

A teenage victim of nonconsensual sexually explicit deepfakes joined Rep. Joe Morelle, D-N.Y., on Tuesday to advocate for a bipartisan bill that would criminalize sharing such material at the federal level. 

In May, Morelle introduced the P…

It’s not just Taylor Swift ‘nudes’: Millions of teen girls victimized as classmates turn them into deepfake porn
nypost.com · 2024

“Imagine a girl waking up and finding an explicit photo or video that looks like her but it isn’t her,” Dorota Mani told The Post.

That’s what happened to Mani’s 14-year-old daughter, Francesca, who discovered in October that classmates at …

Lawsuit Criticizes Lack of Charges in Westfield Fake Nude Pix Case
tapinto.net · 2024

WESTFIELD, NJ --- Government institutions, including the police, failed to protect girls in Westfield High School from being "violated and exploited" by the use of artificial intelligence (AI) to make fake nude pictures, asserts a lawsuit b…

Westfield Teen Attends State of the Union Address as Guest of Congressman Kean
tapinto.net · 2024

WASHINGTON, DC --- Francesca Mani, a Westfield High School sophomore who has been advocating for stronger laws surrounding AI-generated pornography, attended President Biden's State of the Union Address Thursday night as the guest of Congre…

‘Staying silent? Not an option’: family takes fight against deepfake nudes to Washington
theguardian.com · 2024

In October last year, Francesca Mani came home from school in the suburbs of New Jersey with devastating news for her mother, Dorota.

Earlier in the day the 14-year-old had been called into the vice-principal’s office and notified that she …

Teen Boys Deepfaked Her Daughter. Then The School Made It Worse, One Mom Says.
forbes.com · 2024

On October 20, 2023, a then-14-year-old New Jersey high school sophomore learned that one of her own classmates had used an online service to create an artificially-generated image with her face on a nude woman's body. And she wasn't the on…

Teen Girls Confront an Epidemic of Deepfake Nudes in Schools
nytimes.com · 2024
Natasha Singer post-incident response

Westfield Public Schools held a regular board meeting in late March at the local high school, a red brick complex in Westfield, N.J., with a scoreboard outside proudly welcoming visitors to the "Home of the Blue Devils" sports teams.

But it…

Bipartisan push to remove and ban AI deepfake pornography
foxnews.com · 2024

Please see the original source for the video report.

Victims of A.I. deepfake pornography Elliston Berry and Francesca Mani speak out about how they were victims of fake images circulated online and how this impacted their personal lives, i…

TIME100 AI 2024, Francesca Mani: Anti-deepfake activist
time.com · 2024

Last October, 15-year-old New Jersey high school student Franceseca Mani learned that boys in her class had used AI software to fabricate sexually explicit images of Mani and her female classmates. Since then, she has been on a mission to p…

Westfield Teen Named to TIME’s List of 100 Most Influential People in AI
tapinto.net · 2024

WESTFIELD, NJ --- Out of adversity comes opportunity, Benjamin Franklin once said, and today, a Westfield teenager is proving the adage once again: Francesca Mani, a Westfield High School sophomore who has been advocating for stronger laws …

Bold NJ teen makes Time top 100 in AI for fight against deepfakes
nj1015.com · 2024

WESTFIELD — A New Jersey high school student who is the victim of deepfake pornography is now one of the most influential people in artificial intelligence, according to Time.

Francesca Mani is a 15-year-old sophomore at Westfield High Scho…

Deepfake crisis at schools: 'I refuse to wear victim's badge'
koreatimes.co.kr · 2024

The Korea Times Editor's Note: This article is the second in a three-part series on deepfake sex crimes at schools. The crimes, involving the manipulation of photos and videos to create explicit content, cause distrust and strain relationsh…

What happened to Francesca Mani? Artificial Intelligence nudify incident explored as anti-deepfake activist fights for change
soapcentral.com · 2024

Francesca Mani, a high school student from Westfield High School, New Jersey, was a victim of an emerging form of cybercrime that involved artificial intelligence (AI) and deepfake technology in October 2023. The 14-year-old revealed that s…

A teenager created an AI nude of his female classmate and circulated it on Snapchat – he was suspended from school for one day
digitalcameraworld.com · 2024

As members of Parliament in the UK launch a bid to legally ban smartphones in schools, to safeguard children from the potential harm of social media, a teenager in the US is sharing her story after AI nude images of her ended up circulating…

What to know about deepfakes bill backed by Melania Trump
axios.com · 2025
Sareen Habeshian post-incident response

The TAKE IT DOWN Act, an online safety legislation, is gaining steam in Washington, D.C., as first lady Melania Trump expressed her support Monday.

The big picture: The bipartisan bill aims to bolster protections against the non-consensual …

Variants

A "variant" is an incident that shares the same causative factors, produces similar harms, and involves the same intelligent systems as a known AI incident. Rather than index variants as entirely separate incidents, we list variations of incidents under the first similar incident submitted to the database. Unlike other submission types to the incident database, variants are not required to have reporting in evidence external to the Incident Database. Learn more from the research paper.

Similar Incidents

Selected by our editors

Aledo High School Student Allegedly Generates and Distributes Deepfake Nudes of Seven Female Classmates

Oct 2023 · 26 reports
By textual similarity

Did our AI mess up? Flag the unrelated incidents

Google’s YouTube Kids App Presents Inappropriate Content

Google’s YouTube Kids App Presents Inappropriate Content

May 2015 · 14 reports
Uber AV Killed Pedestrian in Arizona

Uber AV Killed Pedestrian in Arizona

Mar 2018 · 25 reports
Wikipedia Vandalism Prevention Bot Loop

Wikipedia Vandalism Prevention Bot Loop

Feb 2017 · 6 reports
Previous IncidentNext Incident

Similar Incidents

Selected by our editors

Aledo High School Student Allegedly Generates and Distributes Deepfake Nudes of Seven Female Classmates

Oct 2023 · 26 reports
By textual similarity

Did our AI mess up? Flag the unrelated incidents

Google’s YouTube Kids App Presents Inappropriate Content

Google’s YouTube Kids App Presents Inappropriate Content

May 2015 · 14 reports
Uber AV Killed Pedestrian in Arizona

Uber AV Killed Pedestrian in Arizona

Mar 2018 · 25 reports
Wikipedia Vandalism Prevention Bot Loop

Wikipedia Vandalism Prevention Bot Loop

Feb 2017 · 6 reports

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2024 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • 1420c8e