Women and girls
Incidents Harmed By
Incident 59757 Report
Female Students at Westfield High School in New Jersey Reportedly Targeted with Deepfake Nudes
2023-10-20
In October 2023, alleged deepfake nude images of female students were created and shared at Westfield High School in New Jersey. One alleged implicated system in this incident is the Clothoff deepfake app. A victim, Francesca Mani, and her mother, Dorota, began advocating for stronger laws after the school’s response reportedly left perpetrators unaccountable. Since the incident, their advocacy has drawn national attention, leading to trips to Washington, D.C., and bipartisan backing for legislation targeting AI-generated nonconsensual content while calling attention to deficiencies in existing legal protections.
MoreIncident 3734 Report
Amazon's Experimental Hiring Tool Allegedly Displayed Gender Bias in Candidate Rankings
2016-08-10
Between 2014 and 2017, Amazon reportedly developed an AI-powered recruiting tool to score job applicants, trained on a decade of resumes purportedly drawn largely from men. Media reports say the system learned to favor male candidates, penalizing terms like "women's" and graduates from certain all-women's colleges. Efforts to remove these biases reportedly did not guarantee fairness, and the project was ultimately abandoned. Amazon reportedly states recruiters never solely relied on the tool.
MoreIncident 1927 Report
Sexist and Racist Google Adsense Advertisements
2013-01-23
Advertisements chosen by Google Adsense are reported as producing sexist and racist results.
MoreIncident 48015 Report
Non-consensual Deepfake Porn Targeted Female Content Creators
2023-01-30
Unauthorized, non-consensual deepfake pornography showing faces of high-profile female streamers and content creators was published on a subscription-based website, which gained notoriety after a male streamer was caught accessing the site.
MoreRelated Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
Related Entities
Incidents involved as both Developer and Deployer
- Incident 1927 Reports
Sexist and Racist Google Adsense Advertisements
- Incident 1810 Reports
Gender Biases of Google Image Search
Incidents involved as Developer
- Incident 16793 Reports
Lyft Driver in Boca Raton, Florida, Allegedly Used Purported Google Gemini-Generated Image to Support False $75 Damage Fee
- Incident 121 Report
Common Biases of Vector Embeddings
Incidents implicated systems
Associated machine learning models trained on historical Amazon resume data
Incidents implicated systems
St George’s Hospital Medical School automated admissions screening program
Incidents implicated systems
Social media users
Incidents Harmed By
- Incident 1613 Reports
Facebook's Ad Delivery Reportedly Excluded Audience along Racial and Gender Lines
- Incident 2103 Reports
Indian Political App Tek Fog Allegedly Hijacked Trends and Manipulated Public Opinion on Other Social Media Platforms
Incidents involved as Deployer
Social media platforms
Incidents involved as both Developer and Deployer
Incidents implicated systems
Natural Cycles
Incidents involved as both Developer and Deployer
Incidents implicated systems
Minors
Incidents Harmed By
- Incident 16238 Reports
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
- Incident 1867 Reports
Algorithm Assessing Risk Faced by Victims of Gender Violence Misclassified Low-Risk Cases, Allegedly Leading to Homicide of Women and Children in Spain
Incidents involved as Deployer
General public of Spain
Incidents Harmed By
- Incident 1867 Reports
Algorithm Assessing Risk Faced by Victims of Gender Violence Misclassified Low-Risk Cases, Allegedly Leading to Homicide of Women and Children in Spain
- Incident 16143 Reports
Two Men Allegedly Created and Distributed Purportedly AI-Generated Sexual Images of 22 Women in Silleda, Galicia
National security and intelligence stakeholders
Incidents Harmed By
- Incident 2103 Reports
Indian Political App Tek Fog Allegedly Hijacked Trends and Manipulated Public Opinion on Other Social Media Platforms
- Incident 11342 Reports
Reported Deepfakes of Ukrainian Deputy PM Olha Stefanishyna Allegedly Supporting Fictional Mobilization Plan for Women
Incidents involved as Deployer
Incidents implicated systems
- Incident 2103 Reports
Indian Political App Tek Fog Allegedly Hijacked Trends and Manipulated Public Opinion on Other Social Media Platforms
- Incident 12062 Reports
Purported AI-Generated Deepfake of Spiritual Leader Sadhguru Used in Investment Scam Allegedly Defrauding Bengaluru Woman of ₹3.75 Crore (~$425,000)
Stability AI
Incidents involved as both Developer and Deployer
Incidents involved as Developer
Students
Incidents Harmed By
- Incident 16238 Reports
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
- Incident 7975 Reports
Teenager Reportedly Makes Deepfake Pornography of 50 Girls at Bacchus Marsh Grammar School in Australia
Incidents involved as Deployer
Deepfake creators
Incidents involved as both Developer and Deployer
Incidents involved as Deployer
University students
Incidents Harmed By
- Incident 4962 Reports
Male College Freshman Allegedly Made Porn Deepfakes Using Female Friend's Face
- Incident 8481 Report
High School Student in Córdoba, Argentina Accused of Using AI to Generate Explicit Images of Classmates
Incidents involved as Deployer
High school students
Incidents Harmed By
- Incident 6172 Reports
Male student allegedly used AI to generate nude photos of female classmates at a high school in Issaquah, Washington
- Incident 8881 Report
Sydney High Schooler Allegedly Generated Deepfakes of Other Students
Incidents involved as Deployer
Politicians
Incidents Harmed By
- Incident 8747 Reports
One in Six Congresswomen Have Reportedly Been Targeted by AI-Generated Nonconsensual Intimate Imagery
- Incident 16847 Reports
Dozens of Dutch Women, Including Politicians and Public Figures, Were Reportedly Targeted With AI-Manipulated Deepfake Pornography
Incidents involved as Deployer
ESPN Generative AI Services
Incidents involved as both Developer and Deployer
Incidents implicated systems
Victims of deepfake child abuse
Incidents Harmed By
- Incident 16238 Reports
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
- Incident 14393 Reports
Former New Orleans Isidore Newman School Teacher Allegedly Used AI to Create Fake Nude Images from Social Media Photos of Girls, Including Students
YouTube
Incidents involved as both Developer and Deployer
- Incident 8731 Report
YouTube Algorithms Allegedly Amplify Eating Disorder Content to Adolescent Girls
Incidents implicated systems
Two unidentified Year 11 students at Gladstone Park Secondary College
Incidents involved as Deployer
Impersonation scammers
Incidents involved as Deployer
- Incident 11312 Reports
Alleged Deepfake Identity Scam Uses Miami Beach Realtor's Likeness to Defraud Victim in the United Kingdom in Purported Romance Scam
- Incident 12062 Reports
Purported AI-Generated Deepfake of Spiritual Leader Sadhguru Used in Investment Scam Allegedly Defrauding Bengaluru Woman of ₹3.75 Crore (~$425,000)
Victims of impersonation scams
Incidents Harmed By
- Incident 11312 Reports
Alleged Deepfake Identity Scam Uses Miami Beach Realtor's Likeness to Defraud Victim in the United Kingdom in Purported Romance Scam
- Incident 12062 Reports
Purported AI-Generated Deepfake of Spiritual Leader Sadhguru Used in Investment Scam Allegedly Defrauding Bengaluru Woman of ₹3.75 Crore (~$425,000)
Tea Dating Advice
Incidents involved as both Developer and Deployer
Incidents implicated systems
Unnamed 57-year-old woman in Bengaluru targeted by scammers impersonating Sadhguru
Incidents Harmed By
Secret Desires
Incidents involved as both Developer and Deployer
Incidents implicated systems
Unnamed woman detained by United States Immigration and Customs Enforcement
Incidents Harmed By
xAI
Incidents involved as both Developer and Deployer
- Incident 13851 Report
X Users Reportedly Prompted Grok to Sexualize Images of Renée Good After Her Killing in Minneapolis
- Incident 15111 Report
Grok Reportedly Generated Images After X Users Asked It to Unredact Epstein-File Photos of Children and Women
Incidents involved as Developer
CDU Parliamentary Group in the Lower Saxony State Parliament
Incidents involved as Deployer
Women employees of the CDU Parliamentary Group in the Lower Saxony State Parliament
Incidents Harmed By
Unnamed Queensland man charged in alleged deepfake sexual-image campaign
Incidents involved as Deployer
Unnamed 35-year-old Silleda man accused of creating AI-generated sexual images
Incidents involved as Deployer
Unnamed 29-year-old man accused of distributing AI-generated sexual images of women in Silleda
Incidents involved as Deployer
Automated license plate reader (ALPR) developers
Incidents involved as Developer
- Incident 16906 Reports
Kechi, Kansas Police Lieutenant Victor Heiar Used Flock Safety License-Plate Reader System to Monitor Estranged Wife
- Incident 16981 Report
Flock Safety License-Plate Reader Reportedly Misread Plate Digit, Prompting Gunpoint Stop of Two Sisters in Española, New Mexico