Minors
Afectado por Incidentes
Incidente 137544 Reportes
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
2026-02-10
After the 02/10/2026 school shooting in Tumbler Ridge, British Columbia, OpenAI said a user later identified as the suspect, Jesse Van Rootselaar, had previously used ChatGPT to describe scenarios involving gun violence. Those chats were reportedly auto-flagged and reviewed and the account was banned, but OpenAI says it did not alert the RCMP because it allegedly did not present a credible, imminent threat; the company reportedly contacted police after the attack.
MásIncidente 62418 Reportes
Child Sexual Abuse Material Taints Image Generators
2023-12-20
The LAION-5B dataset (a commonly used dataset with more than 5 billion image-description pairs) was found by researchers to contain child sexual abuse material (CSAM), which increases the likelihood that downstream models will produce CSAM imagery. The discovery taints models built with the LAION dataset requiring many organizations to retrain those models. Additionally, LAION must now scrub the dataset of the imagery.
MásIncidente 5516 Reportes
Alexa Plays Pornography Instead of Kids Song
2016-12-30
An Amazon Echo Dot using the Amazon Alex software started to play pornographic results when a child asked it to play a song.
MásIncidente 114 Reportes
Google’s YouTube Kids App Presents Inappropriate Content
2015-05-19
YouTube’s content filtering and recommendation algorithms exposed children to disturbing and inappropriate videos.
MásIncidents involved as Deployer
Incidente 16238 Reportes
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
2023-11-01
From November 2023 through May 2024, two Lancaster Country Day School students in Pennsylvania allegedly used AI tools to create and exchange hundreds of sexualized deepfake images depicting female classmates and other girls. Authorities later identified 60 victims, 59 of them minors. The students were adjudicated delinquent in juvenile court, and families later sued the school and unnamed AI companies over the incident.
MásIncidente 6172 Reportes
Male student allegedly used AI to generate nude photos of female classmates at a high school in Issaquah, Washington
2023-11-09
At a high school in Issaquah, Washington, a male student is reported to have used deepfake technology to alter pictures of several female classmates and then shared them.
MásIncidente 14102 Reportes
Purportedly AI-Generated Explicit Images of Royal School Armagh Girls Reportedly Circulated Among Pupils
2026-01-17
Police in Northern Ireland reportedly investigated allegations that explicit purportedly AI-generated images of girls attending Royal School Armagh were created and shared among pupils. The images allegedly targeted multiple students and circulated within the school community.
MásIncidente 16052 Reportes
Purportedly AI-Generated Image Prompted Emergency Investigation of False Fire at South Africa's Orlando West High School
2026-01-05
A purportedly AI-generated image reportedly depicting Orlando West High School of Soweto, South Africa, on fire circulated and was allegedly shared with emergency services. Johannesburg EMS reportedly investigated and visited the school, confirming that no fire had occurred. Officials said the false report caused public alarm and diverted emergency resources.
MásEntidades relacionadas
Otras entidades que están relacionadas con el mismo incidente. Por ejemplo, si el desarrollador de un incidente es esta entidad pero el implementador es otra entidad, se marcan como entidades relacionadas.
Entidades relacionadas
International Baccalaureate Organization
Incidentes involucrados como desarrollador e implementador
Students
Afectado por Incidentes
- Incidente 137544 Report
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
- Incidente 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
Incidents involved as Deployer
- Incidente 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
- Incidente 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
Teachers
Afectado por Incidentes
- Incidente 137544 Report
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
- Incidente 10094 Report
Purportedly AI-Assisted Report by Tromsø Officials Allegedly Cited Non-Existent Sources in School Closure Proposal
Incidents involved as Deployer
Privacy
Afectado por Incidentes
- Incidente 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
- Incidente 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
AI-enabled decision support systems
Incidents implicated systems
- Incidente 137544 Report
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
- Incidente 1867 Report
Algorithm Assessing Risk Faced by Victims of Gender Violence Misclassified Low-Risk Cases, Allegedly Leading to Homicide of Women and Children in Spain
Women
Afectado por Incidentes
- Incidente 1867 Report
Algorithm Assessing Risk Faced by Victims of Gender Violence Misclassified Low-Risk Cases, Allegedly Leading to Homicide of Women and Children in Spain
- Incidente 10042 Report
San Francisco City Attorney Sues Operators of AI Deepfake Pornography Websites for Violations of State and Federal Law
Women and girls
Afectado por Incidentes
- Incidente 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
- Incidente 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
Child sexual abuse victims
Afectado por Incidentes
- Incidente 95811 Report
Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material
- Incidente 4124 Report
Finnish Police Were Reportedly Reprimanded After National Bureau of Investigation Unit Allegedly Used Clearview AI to Identify Potential Abuse Victims
OpenAI
Incidentes involucrados como desarrollador e implementador
- Incidente 137544 Report
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
- Incidente 11929 Report
16-Year-Old Allegedly Received Suicide Method Guidance from ChatGPT Before Death
Incidents involved as Developer
Large language model developers
Incidents involved as Developer
- Incidente 137544 Report
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
- Incidente 5135 Report
ChatGPT Reportedly Banned by Italian Authority Due to OpenAI's Purported Lack of Legal Basis for Data Collection and Age Verification
Incidents implicated systems
Chatbot developers
Incidents involved as Developer
- Incidente 137544 Report
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
- Incidente 5135 Report
ChatGPT Reportedly Banned by Italian Authority Due to OpenAI's Purported Lack of Legal Basis for Data Collection and Age Verification
Incidents implicated systems
Chatbots
Incidents implicated systems
- Incidente 5135 Report
ChatGPT Reportedly Banned by Italian Authority Due to OpenAI's Purported Lack of Legal Basis for Data Collection and Age Verification
- Incidente 16194 Report
Bentonville, Arkansas, Photographer Allegedly Used Grok to Create AI-Generated Child Sexual Abuse Material from Clients' Photos
Synthetic image generation technology developers
Incidents involved as Developer
- Incidente 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
- Incidente 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
Incidents implicated systems
Social media users
Afectado por Incidentes
- Incidente 5613 Report
OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent
- Incidente 11083 Report
Digital Rights Groups Accuse Meta and Character.AI of Facilitating Unlicensed Therapy via Chatbots
Incidents involved as Deployer
Synthetic image generation technology
Incidents implicated systems
- Incidente 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
- Incidente 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
Incidentes involucrados como desarrollador e implementador
- Incidente 5831 Report
Instagram Algorithms Allegedly Promote Accounts Facilitating Child Sex Abuse Content
- Incidente 7881 Report
Instagram's Algorithm Reportedly Recommended Sexual Content to Teenagers' Accounts
Incidents involved as Deployer
Incidents implicated systems
Schools and teachers who were misinformed and burdened with COPPA compliance responsibilities without adequate disclosure
Afectado por Incidentes
Synthetic media creators
Incidents involved as Deployer
- Incidente 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
- Incidente 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
High school students
Afectado por Incidentes
- Incidente 137544 Report
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
- Incidente 12503 Report
Alleged False Positive by Omnilert AI Gun Detection System Prompts Police Search at Baltimore County High School
Incidents involved as Deployer
Deepfake creators
Incidentes involucrados como desarrollador e implementador
Incidents involved as Deployer
Synthetic video generation technology developers
Incidents involved as Developer
- Incidente 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
- Incidente 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
Synthetic media generation technology developers
Incidents involved as Developer
- Incidente 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
- Incidente 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
Incidents implicated systems
Deepfake technology developers
Incidents involved as Developer
- Incidente 95811 Report
Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material
- Incidente 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
Incidents implicated systems
Victims of non-consensual deepfakes
Afectado por Incidentes
- Incidente 14393 Report
Former New Orleans Isidore Newman School Teacher Allegedly Used AI to Create Fake Nude Images from Social Media Photos of Girls, Including Students
- Incidente 6172 Report
Male student allegedly used AI to generate nude photos of female classmates at a high school in Issaquah, Washington
Girls
Afectado por Incidentes
- Incidente 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
- Incidente 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
Synthetic video generation technology
Incidents implicated systems
- Incidente 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
- Incidente 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
Synthetic media generation technology
Incidents implicated systems
- Incidente 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
- Incidente 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
Replika
Incidentes involucrados como desarrollador e implementador
Incidents implicated systems
Snapchat
Incidentes involucrados como desarrollador e implementador
- Incidente 5391 Report
Snapchat's My AI Reported for Lacking Protection for Children
- Incidente 6461 Report
Snapchat's Algorithm Alleged to Link Minor with Sex Offenders
Incidents implicated systems
Epistemic integrity
Afectado por Incidentes
- Incidente 95811 Report
Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material
- Incidente 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
Incidents implicated systems
Educators
Afectado por Incidentes
- Incidente 14922 Report
Purportedly AI-Enabled Targeting System Was Reportedly Implicated in Deadly U.S. Strike on Iranian Primary School
- Incidente 16122 Report
A.B. Paterson College Teacher in Queensland Allegedly Used AI to Create Explicit Images of Students and Staff
Incidents involved as Deployer
Richland School District students
Afectado por Incidentes
- Incidente 8871 Report
Students of Richland School District in Cambria County, Pennsylvania Allegedly Used AI to Generate Obscene Images of Other Students
- Incidente 8871 Report
Students of Richland School District in Cambria County, Pennsylvania Allegedly Used AI to Generate Obscene Images of Other Students
Incidents involved as Deployer
- Incidente 8871 Report
Students of Richland School District in Cambria County, Pennsylvania Allegedly Used AI to Generate Obscene Images of Other Students
- Incidente 8871 Report
Students of Richland School District in Cambria County, Pennsylvania Allegedly Used AI to Generate Obscene Images of Other Students
Social media platforms
Incidentes involucrados como desarrollador e implementador
Incidents implicated systems
Character.ai
Incidentes involucrados como desarrollador e implementador
- Incidente 12775 Report
Alleged Harmful Outputs and Data Exposure in Children's AI Products by FoloToy, Miko, and Character.AI
- Incidente 11083 Report
Digital Rights Groups Accuse Meta and Character.AI of Facilitating Unlicensed Therapy via Chatbots
Incidents implicated systems
Gaggle
Incidentes involucrados como desarrollador e implementador
Incidents involved as Developer
Incidents implicated systems
- Incidente 11671 Report
Alleged Gaggle Surveillance Alert Reportedly Leads to Arrest and Detention of 13-Year-Old Student in Fairview, Tennessee
- Incidente 12151 Report
Gaggle Alert Reportedly Leads to Arrest of 15-Year-Old in Volusia County, Florida, for School Threat the Student Claimed Was Not Serious
Chatbot users
Afectado por Incidentes
- Incidente 11929 Report
16-Year-Old Allegedly Received Suicide Method Guidance from ChatGPT Before Death
- Incidente 12001 Report
Meta AI on Instagram Reportedly Facilitated Suicide and Eating Disorder Roleplay with Teen Accounts
Incidents involved as Developer
Incidents involved as Deployer
Unknown actor(s) creating deepfake nudes of Sydney high school students
Incidents involved as Deployer
Omnilert
Incidents involved as Developer
- Incidente 12503 Report
Alleged False Positive by Omnilert AI Gun Detection System Prompts Police Search at Baltimore County High School
- Incidente 12671 Report
Omnilert AI Reportedly Triggered False Gun Alert at Parkville High, Prompting Student Relocation
Incidents implicated systems
Waymo
Incidentes involucrados como desarrollador e implementador
- Incidente 13003 Report
Waymo Self-Driving Vehicles Reportedly Passed Stopped School Buses at Least 19 Times, Prompting NHTSA Probe
- Incidente 13612 Report
Waymo Autonomous Vehicle Reportedly Struck Child Near Elementary School in Santa Monica, California
Incidents implicated systems
Unnamed students at Mountain View Middle School
Afectado por Incidentes
Incidents involved as Deployer
Unnamed students at Western Dubuque Community School District
Afectado por Incidentes
Incidents involved as Deployer
Families of unnamed students at Western Dubuque Community School District
Afectado por Incidentes
AI-generated CSAM creators
Incidents involved as Deployer
- Incidente 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
- Incidente 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
xAI
Incidentes involucrados como desarrollador e implementador
Incidents involved as Developer
Lake Zurich High School students
Afectado por Incidentes
- Incidente 15741 Report
Purportedly AI-Generated Explicit Images of Students Allegedly Circulated at Lake Zurich High School in Illinois
- Incidente 15741 Report
Purportedly AI-Generated Explicit Images of Students Allegedly Circulated at Lake Zurich High School in Illinois
Incidents involved as Deployer
Unidentified creators or distributors of AI-generated video targeting a Laredo, Texas, teenager
Incidents involved as Deployer
A.B. Paterson College students and staff depicted in alleged AI-generated explicit images
Afectado por Incidentes
Victims of CSAM
Afectado por Incidentes
- Incidente 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
- Incidente 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
Two unnamed Lancaster Country Day School students
Incidents involved as Deployer
- Incidente 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
- Incidente 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
Lancaster Country Day School students
Afectado por Incidentes
- Incidente 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
- Incidente 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
Lancaster Country Day School
Afectado por Incidentes
- Incidente 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
- Incidente 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
Families of Lancaster Country Day School students
Afectado por Incidentes
- Incidente 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
- Incidente 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls