Women and girls
Incidents Harmed By
Incident 59757 Report
Female Students at Westfield High School in New Jersey Reportedly Targeted with Deepfake Nudes
2023-10-20
In October 2023, alleged deepfake nude images of female students were created and shared at Westfield High School in New Jersey. One alleged implicated system in this incident is the Clothoff deepfake app. A victim, Francesca Mani, and her mother, Dorota, began advocating for stronger laws after the school’s response reportedly left perpetrators unaccountable. Since the incident, their advocacy has drawn national attention, leading to trips to Washington, D.C., and bipartisan backing for legislation targeting AI-generated nonconsensual content while calling attention to deficiencies in existing legal protections.
MoreIncident 3734 Report
Amazon’s Experimental Hiring Tool Allegedly Displayed Gender Bias in Candidate Rankings
2016-08-10
Between 2014 and 2017, Amazon reportedly developed an AI-powered recruiting tool to score job applicants, trained on a decade of resumes purportedly drawn largely from men. Media reports say the system learned to favor male candidates, penalizing terms like "women's" and graduates from certain all-women's colleges. Efforts to remove these biases reportedly did not guarantee fairness, and the project was ultimately abandoned. Amazon reportedly states recruiters never solely relied on the tool.
MoreIncident 1927 Report
Sexist and Racist Google Adsense Advertisements
2013-01-23
Advertisements chosen by Google Adsense are reported as producing sexist and racist results.
MoreIncident 48015 Report
Non-consensual Deepfake Porn Targeted Female Content Creators
2023-01-30
Unauthorized, non-consensual deepfake pornography showing faces of high-profile female streamers and content creators was published on a subscription-based website, which gained notoriety after a male streamer was caught accessing the site.
MoreRelated Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
Related Entities
Incidents involved as both Developer and Deployer
- Incident 1927 Reports
Sexist and Racist Google Adsense Advertisements
- Incident 1810 Reports
Gender Biases of Google Image Search
Incidents involved as Developer
- Incident 121 Report
Common Biases of Vector Embeddings
- Incident 811 Report
Researchers find evidence of racial, gender, and socioeconomic bias in chest X-ray classifiers
Incidents implicated systems
Associated machine learning models trained on historical Amazon resume data
Incidents implicated systems
St George’s Hospital Medical School automated admissions screening program
Incidents implicated systems
Social media platforms
Incidents involved as both Developer and Deployer
Incidents implicated systems
Natural Cycles
Incidents involved as both Developer and Deployer
Incidents implicated systems
Minors
Incidents Harmed By
- Incident 1867 Reports
Algorithm Assessing Risk Faced by Victims of Gender Violence Misclassified Low-Risk Cases, Allegedly Leading to Homicide of Women and Children in Spain
- Incident 13423 Reports
Purported Deepfake Nude Images of Students Circulated Without Consent at Valencia Educational Institute
Incidents involved as Deployer
General public of Spain
Incidents Harmed By
- Incident 1867 Reports
Algorithm Assessing Risk Faced by Victims of Gender Violence Misclassified Low-Risk Cases, Allegedly Leading to Homicide of Women and Children in Spain
- Incident 16143 Reports
Two Men Allegedly Created and Distributed Purportedly AI-Generated Sexual Images of 22 Women in Silleda, Galicia
General public
Incidents Harmed By
- Incident 1867 Reports
Algorithm Assessing Risk Faced by Victims of Gender Violence Misclassified Low-Risk Cases, Allegedly Leading to Homicide of Women and Children in Spain
- Incident 16143 Reports
Two Men Allegedly Created and Distributed Purportedly AI-Generated Sexual Images of 22 Women in Silleda, Galicia
Stability AI
Incidents involved as both Developer and Deployer
Incidents involved as Developer
Students
Incidents Harmed By
- Incident 4383 Reports
Henan Authorities Reportedly Commissioned Facial Recognition System to Track Journalists and International Students
- Incident 13423 Reports
Purported Deepfake Nude Images of Students Circulated Without Consent at Valencia Educational Institute
Incidents involved as Deployer
Synthetic media generation technology
Incidents involved as Developer
Incidents implicated systems
Synthetic video generation technology
Incidents involved as Developer
Incidents implicated systems
High school students
Incidents Harmed By
- Incident 6172 Reports
Male student allegedly used AI to generate nude photos of female classmates at a high school in Issaquah, Washington
- Incident 9431 Report
Nonconsensual Explicit AI-Generated Images of Up to 60 Gladstone Park Secondary College Students in Victoria, Australia, Reportedly Created and Circulated Online
Incidents involved as Deployer
- Incident 6172 Reports
Male student allegedly used AI to generate nude photos of female classmates at a high school in Issaquah, Washington
- Incident 9431 Report
Nonconsensual Explicit AI-Generated Images of Up to 60 Gladstone Park Secondary College Students in Victoria, Australia, Reportedly Created and Circulated Online