Minors
Affecté par des incidents
Incident 137544 Rapports
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
2026-02-10
After the 02/10/2026 school shooting in Tumbler Ridge, British Columbia, OpenAI said a user later identified as the suspect, Jesse Van Rootselaar, had previously used ChatGPT to describe scenarios involving gun violence. Those chats were reportedly auto-flagged and reviewed and the account was banned, but OpenAI says it did not alert the RCMP because it allegedly did not present a credible, imminent threat; the company reportedly contacted police after the attack.
PlusIncident 62418 Rapports
Child Sexual Abuse Material Taints Image Generators
2023-12-20
The LAION-5B dataset (a commonly used dataset with more than 5 billion image-description pairs) was found by researchers to contain child sexual abuse material (CSAM), which increases the likelihood that downstream models will produce CSAM imagery. The discovery taints models built with the LAION dataset requiring many organizations to retrain those models. Additionally, LAION must now scrub the dataset of the imagery.
PlusIncident 5516 Rapports
Alexa Plays Pornography Instead of Kids Song
2016-12-30
An Amazon Echo Dot using the Amazon Alex software started to play pornographic results when a child asked it to play a song.
PlusIncident 114 Rapports
Google’s YouTube Kids App Presents Inappropriate Content
2015-05-19
YouTube’s content filtering and recommendation algorithms exposed children to disturbing and inappropriate videos.
PlusIncidents involved as Deployer
Incident 16238 Rapports
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
2023-11-01
From November 2023 through May 2024, two Lancaster Country Day School students in Pennsylvania allegedly used AI tools to create and exchange hundreds of sexualized deepfake images depicting female classmates and other girls. Authorities later identified 60 victims, 59 of them minors. The students were adjudicated delinquent in juvenile court, and families later sued the school and unnamed AI companies over the incident.
PlusIncident 16884 Rapports
Teenager in Quilmes, Argentina, Reportedly Consulted ChatGPT While Planning School Shooting Against Classmates
2026-08-19
Argentine authorities reported that a 15-year-old in Quilmes allegedly discussed a planned school shooting with ChatGPT, including tactical preparations, before an FBI alert prompted an investigation by the Argentine Federal Police. Police later seized phones and tactical clothing; no firearms or ammunition were reported. Public reporting does not establish what ChatGPT answered or whether it materially assisted the alleged plan.
PlusIncident 6172 Rapports
Male student allegedly used AI to generate nude photos of female classmates at a high school in Issaquah, Washington
2023-11-09
At a high school in Issaquah, Washington, a male student is reported to have used deepfake technology to alter pictures of several female classmates and then shared them.
PlusIncident 14102 Rapports
Purportedly AI-Generated Explicit Images of Royal School Armagh Girls Reportedly Circulated Among Pupils
2026-01-17
Police in Northern Ireland reportedly investigated allegations that explicit purportedly AI-generated images of girls attending Royal School Armagh were created and shared among pupils. The images allegedly targeted multiple students and circulated within the school community.
PlusEntités liées
Autres entités liées au même incident. Par exemple, si le développeur d'un incident est cette entité mais que le responsable de la mise en œuvre est une autre entité, ils sont marqués comme entités liées.
Entités liées
International Baccalaureate Organization
Incidents impliqués en tant que développeur et déployeur
Students
Affecté par des incidents
- Incident 137544 Report
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
- Incident 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
Incidents involved as Deployer
Teachers
Affecté par des incidents
- Incident 137544 Report
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
- Incident 10094 Report
Purportedly AI-Assisted Report by Tromsø Officials Allegedly Cited Non-Existent Sources in School Closure Proposal
Incidents involved as Deployer
AI-enabled decision support systems
Incidents implicated systems
- Incident 137544 Report
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
- Incident 1867 Report
Algorithm Assessing Risk Faced by Victims of Gender Violence Misclassified Low-Risk Cases, Allegedly Leading to Homicide of Women and Children in Spain
Women
Affecté par des incidents
- Incident 1867 Report
Algorithm Assessing Risk Faced by Victims of Gender Violence Misclassified Low-Risk Cases, Allegedly Leading to Homicide of Women and Children in Spain
- Incident 14483 Report
Ohio Man Pleaded Guilty after Prosecutors Alleged He Used AI to Create and Distribute Nonconsensual Intimate-Image Forgeries Including CSAM in Harassment Campaign
Law enforcement
Incidents involved as Deployer
- Incident 4124 Report
Finnish Police Were Reportedly Reprimanded After National Bureau of Investigation Unit Allegedly Used Clearview AI to Identify Potential Abuse Victims
- Incident 16981 Report
Flock Safety License-Plate Reader Reportedly Misread Plate Digit, Prompting Gunpoint Stop of Two Sisters in Española, New Mexico
Child sexual abuse victims
Affecté par des incidents
- Incident 95811 Report
Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material
- Incident 4124 Report
Finnish Police Were Reportedly Reprimanded After National Bureau of Investigation Unit Allegedly Used Clearview AI to Identify Potential Abuse Victims
OpenAI
Incidents impliqués en tant que développeur et déployeur
- Incident 137544 Report
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
- Incident 11929 Report
16-Year-Old Allegedly Received Suicide Method Guidance from ChatGPT Before Death
Incidents involved as Developer
Large language model developers
Incidents involved as Developer
- Incident 137544 Report
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
- Incident 5135 Report
ChatGPT Reportedly Banned by Italian Authority Due to OpenAI's Purported Lack of Legal Basis for Data Collection and Age Verification
Incidents implicated systems
Chatbot developers
Incidents involved as Developer
- Incident 137544 Report
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
- Incident 5135 Report
ChatGPT Reportedly Banned by Italian Authority Due to OpenAI's Purported Lack of Legal Basis for Data Collection and Age Verification
Incidents implicated systems
Chatbots
Incidents implicated systems
- Incident 5135 Report
ChatGPT Reportedly Banned by Italian Authority Due to OpenAI's Purported Lack of Legal Basis for Data Collection and Age Verification
- Incident 16194 Report
Bentonville, Arkansas, Photographer Allegedly Used Grok to Create AI-Generated Child Sexual Abuse Material from Clients' Photos
Synthetic image generation technology developers
Incidents involved as Developer
- Incident 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
- Incident 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
Incidents implicated systems
Social media users
Affecté par des incidents
- Incident 5613 Report
OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent
- Incident 11083 Report
Digital Rights Groups Accuse Meta and Character.AI of Facilitating Unlicensed Therapy via Chatbots
Incidents involved as Deployer
Incidents impliqués en tant que développeur et déployeur
- Incident 5831 Report
Instagram Algorithms Allegedly Promote Accounts Facilitating Child Sex Abuse Content
- Incident 7881 Report
Instagram's Algorithm Reportedly Recommended Sexual Content to Teenagers' Accounts
Incidents involved as Deployer
Incidents implicated systems
Adolescents
Affecté par des incidents
- Incident 16793 Report
Lyft Driver in Boca Raton, Florida, Allegedly Used Purported Google Gemini-Generated Image to Support False $75 Damage Fee
- Incident 15922 Report
Purportedly AI-Generated Images Reportedly Used During Four-Year Catfishing Campaign Targeting Welsh Teenager
Incidents involved as Deployer
Schools and teachers who were misinformed and burdened with COPPA compliance responsibilities without adequate disclosure
Affecté par des incidents
High school students
Affecté par des incidents
- Incident 137544 Report
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
- Incident 12503 Report
Alleged False Positive by Omnilert AI Gun Detection System Prompts Police Search at Baltimore County High School
Incidents involved as Deployer
Deepfake creators
Incidents impliqués en tant que développeur et déployeur
Incidents involved as Deployer
Boys
Affecté par des incidents
- Incident 15365 Report
Humanoid Robot Identified as Likely Unitree G1 Reportedly Kicked Boy During Public Demonstration in Xinjiang
- Incident 16914 Report
ChatGPT Was Reportedly Used to Plan Zürich-Oerlikon Knife Attack That Seriously Injured Three Five-Year-Old Boys
Incidents involved as Deployer
Synthetic media generation technology developers
Incidents involved as Developer
- Incident 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
- Incident 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
Incidents implicated systems
Deepfake technology developers
Incidents involved as Developer
- Incident 95811 Report
Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material
- Incident 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
Incidents implicated systems
Victims of non-consensual deepfakes
Affecté par des incidents
- Incident 14393 Report
Former New Orleans Isidore Newman School Teacher Allegedly Used AI to Create Fake Nude Images from Social Media Photos of Girls, Including Students
- Incident 14483 Report
Ohio Man Pleaded Guilty after Prosecutors Alleged He Used AI to Create and Distribute Nonconsensual Intimate-Image Forgeries Including CSAM in Harassment Campaign
Replika
Incidents impliqués en tant que développeur et déployeur
Incidents implicated systems
Snapchat
Incidents impliqués en tant que développeur et déployeur
- Incident 5391 Report
Snapchat's My AI Reported for Lacking Protection for Children
- Incident 6461 Report
Snapchat's Algorithm Alleged to Link Minor with Sex Offenders
Incidents implicated systems
Epistemic integrity
Affecté par des incidents
- Incident 95811 Report
Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material
- Incident 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
Incidents implicated systems
Educators
Affecté par des incidents
- Incident 16884 Report
Teenager in Quilmes, Argentina, Reportedly Consulted ChatGPT While Planning School Shooting Against Classmates
- Incident 16884 Report
Teenager in Quilmes, Argentina, Reportedly Consulted ChatGPT While Planning School Shooting Against Classmates
Incidents involved as Deployer
Richland School District students
Affecté par des incidents
- Incident 8871 Report
Students of Richland School District in Cambria County, Pennsylvania Allegedly Used AI to Generate Obscene Images of Other Students
- Incident 8871 Report
Students of Richland School District in Cambria County, Pennsylvania Allegedly Used AI to Generate Obscene Images of Other Students
Incidents involved as Deployer
- Incident 8871 Report
Students of Richland School District in Cambria County, Pennsylvania Allegedly Used AI to Generate Obscene Images of Other Students
- Incident 8871 Report
Students of Richland School District in Cambria County, Pennsylvania Allegedly Used AI to Generate Obscene Images of Other Students
Social media platforms
Incidents impliqués en tant que développeur et déployeur
Incidents implicated systems
Character.ai
Incidents impliqués en tant que développeur et déployeur
- Incident 12775 Report
Alleged Harmful Outputs and Data Exposure in Children's AI Products by FoloToy, Miko, and Character.AI
- Incident 11083 Report
Digital Rights Groups Accuse Meta and Character.AI of Facilitating Unlicensed Therapy via Chatbots
Incidents implicated systems
Gaggle
Incidents impliqués en tant que développeur et déployeur
Incidents involved as Developer
Incidents implicated systems
Chatbot users
Affecté par des incidents
- Incident 11929 Report
16-Year-Old Allegedly Received Suicide Method Guidance from ChatGPT Before Death
- Incident 12001 Report
Meta AI on Instagram Reportedly Facilitated Suicide and Eating Disorder Roleplay with Teen Accounts
Incidents involved as Developer
Incidents involved as Deployer
Unknown actor(s) creating deepfake nudes of Sydney high school students
Incidents involved as Deployer
Omnilert
Incidents involved as Developer
- Incident 12503 Report
Alleged False Positive by Omnilert AI Gun Detection System Prompts Police Search at Baltimore County High School
- Incident 12671 Report
Omnilert AI Reportedly Triggered False Gun Alert at Parkville High, Prompting Student Relocation
Incidents implicated systems
Family of students of Escuela Secundaria Técnica No. 1 in Zacatecas
Affecté par des incidents
Waymo
Incidents impliqués en tant que développeur et déployeur
- Incident 13003 Report
Waymo Self-Driving Vehicles Reportedly Passed Stopped School Buses at Least 19 Times, Prompting NHTSA Probe
- Incident 13612 Report
Waymo Autonomous Vehicle Reportedly Struck Child Near Elementary School in Santa Monica, California
Incidents implicated systems
ZeroEyes AI-powered video surveillance weapon detection system
Incidents implicated systems
Unnamed students at Mountain View Middle School
Affecté par des incidents
Incidents involved as Deployer
Unnamed students at Western Dubuque Community School District
Affecté par des incidents
Incidents involved as Deployer
Families of unnamed students at Western Dubuque Community School District
Affecté par des incidents
xAI
Incidents impliqués en tant que développeur et déployeur
Incidents involved as Developer
Lake Zurich High School students
Affecté par des incidents
- Incident 15741 Report
Purportedly AI-Generated Explicit Images of Students Allegedly Circulated at Lake Zurich High School in Illinois
- Incident 15741 Report
Purportedly AI-Generated Explicit Images of Students Allegedly Circulated at Lake Zurich High School in Illinois