Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse

Report 3292

Associated Incidents

Incident 59757 Report
Female Students at Westfield High School in New Jersey Reportedly Targeted with Deepfake Nudes

Loading...
High schoolers accused of making AI-generated pornographic images of their classmates
wsaz.com · 2023

WESTFIELD, N.J. (WCBS) – Some New Jersey high school students are accused of sharing AI-generated nude photos of their classmates.

The incident happened over the summer but was just recently brought to the attention of administrators at Westfield High School.

Dorota Mani plans to advocate for her daughter, who is a high schooler that became a victim of these deepfakes.

“My daughter texted me, ‘Mom, naked pictures of me are being distributed.’ That’s it. ‘Heading to the principal’s office,’” Mani said.

Mani said her daughter started crying and saw fellow classmates walking in the hallways who were also crying.

Parents later got an email from the principal, reading in part:

“Students brought to our attention that some of our students had used artificial intelligence to create pornographic images from original photos. The kind of altered pictures known online as deepfakes.”

The principal’s email went on to warn parents:

“New technologies have made it possible to falsify images and students need to know the impact and dangers those actions can cause to others.”

The email also encouraged victims to contact the police, and Mani said she did file a police report.

The school district said they can’t comment on how many students are affected or any disciplinary actions that are being taken.

Congress is considering a bill introduced by representative Joe Morelle of New York that would make it illegal to share non-consensual deepfake images online.

Mani and her daughter plan to advocate for laws to protect people from deepfakes.

“It’s something that we will need to learn, our children will need to be aware of,” Mani said.

Copyright 2023 WCBS via CNN Newsource. All rights reserved.

Read the Source

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2024 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • e1b50cd