Minors
Afectado por Incidentes
Incidente 137544 Reportes
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
2026-02-10
After the 02/10/2026 school shooting in Tumbler Ridge, British Columbia, OpenAI said a user later identified as the suspect, Jesse Van Rootselaar, had previously used ChatGPT to describe scenarios involving gun violence. Those chats were reportedly auto-flagged and reviewed and the account was banned, but OpenAI says it did not alert the RCMP because it allegedly did not present a credible, imminent threat; the company reportedly contacted police after the attack.
MásIncidente 62418 Reportes
Child Sexual Abuse Material Taints Image Generators
2023-12-20
The LAION-5B dataset (a commonly used dataset with more than 5 billion image-description pairs) was found by researchers to contain child sexual abuse material (CSAM), which increases the likelihood that downstream models will produce CSAM imagery. The discovery taints models built with the LAION dataset requiring many organizations to retrain those models. Additionally, LAION must now scrub the dataset of the imagery.
MásIncidente 5516 Reportes
Alexa Plays Pornography Instead of Kids Song
2016-12-30
An Amazon Echo Dot using the Amazon Alex software started to play pornographic results when a child asked it to play a song.
MásIncidente 114 Reportes
Google’s YouTube Kids App Presents Inappropriate Content
2015-05-19
YouTube’s content filtering and recommendation algorithms exposed children to disturbing and inappropriate videos.
MásIncidents involved as Deployer
Incidente 8871 Reporte
Students of Richland School District in Cambria County, Pennsylvania Allegedly Used AI to Generate Obscene Images of Other Students
2024-11-14
The Richland School District (Cambria County, Pennsylvania) released a statement on November 19, 2024 announcing an investigation into "some secondary students" who are alleged to have used AI to "create and electronically distribute obscene images of Richland students." The school administrators became aware of the incident on November 14, 2024.
MásIncidente 9451 Reporte
Two 16-Year-Old Students in Athens, Greece Allegedly Generated Nonconsensual Deepfake Pornography of Their Classmates
2025-02-19
In Athens, Greece, two 16-year-old students were arrested for allegedly generated nonconsensual deepfake pornography of their classmates. They reportedly used images taken from social media to create the explicit images, which they are then reported to have disseminated online to others. The parents of the students were reportedly also arrested for neglecting to supervise their behavior.
MásIncidente 14741 Reporte
Tasmanian School Students Reportedly Created Purported AI-Generated Pornographic Images of Female Classmates
2026-04-01
Five boys at The Friends' School in Hobart, Tasmania allegedly created purported AI-generated pornographic images using photos of female classmates, with parents saying 21 girls were identified as victims. The images were reportedly shared in a boys' group chat. Tasmania Police said no charges had been laid and the youths were being dealt with under the Youth Justice Act.
MásEntidades relacionadas
Otras entidades que están relacionadas con el mismo incidente. Por ejemplo, si el desarrollador de un incidente es esta entidad pero el implementador es otra entidad, se marcan como entidades relacionadas.
Entidades relacionadas
International Baccalaureate Organization
Incidentes involucrados como desarrollador e implementador
Students
Afectado por Incidentes
- Incidente 137544 Report
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
- Incidente 8917 Report
Purported AI Voice Scam Reportedly Targets Westchester Parents with Fake Kidnapping Ransom Calls
Incidents involved as Deployer
Teachers
Afectado por Incidentes
- Incidente 137544 Report
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
- Incidente 10094 Report
Purportedly AI-Assisted Report by Tromsø Officials Allegedly Cited Non-Existent Sources in School Closure Proposal
Incidents involved as Deployer
Women
Afectado por Incidentes
- Incidente 1867 Report
Algorithm Assessing Risk Faced by Victims of Gender Violence Misclassified Low-Risk Cases, Allegedly Leading to Homicide of Women and Children in Spain
- Incidente 14482 Report
Ohio Man Pleaded Guilty after Prosecutors Alleged He Used AI to Create and Distribute Nonconsensual Intimate-Image Forgeries Including CSAM in Harassment Campaign
Privacy
Afectado por Incidentes
- Incidente 5135 Report
ChatGPT Reportedly Banned by Italian Authority Due to OpenAI's Purported Lack of Legal Basis for Data Collection and Age Verification
- Incidente 4124 Report
Finnish Police Were Reportedly Reprimanded After National Bureau of Investigation Unit Allegedly Used Clearview AI to Identify Potential Abuse Victims
Replika
Incidentes involucrados como desarrollador e implementador
Incidents implicated systems
OpenAI
Incidentes involucrados como desarrollador e implementador
- Incidente 137544 Report
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
- Incidente 11928 Report
16-Year-Old Allegedly Received Suicide Method Guidance from ChatGPT Before Death
Incidents involved as Developer
Snapchat
Incidentes involucrados como desarrollador e implementador
- Incidente 5391 Report
Snapchat's My AI Reported for Lacking Protection for Children
- Incidente 6461 Report
Snapchat's Algorithm Alleged to Link Minor with Sex Offenders
Incidents implicated systems
Meta
Incidentes involucrados como desarrollador e implementador
- Incidente 7232 Report
Instagram Algorithms Reportedly Directed Children's Merchandise Ad Campaign to Adult Men and Sex Offenders
- Incidente 10402 Report
Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas
Incidents implicated systems
Incidentes involucrados como desarrollador e implementador
- Incidente 5831 Report
Instagram Algorithms Allegedly Promote Accounts Facilitating Child Sex Abuse Content
- Incidente 7881 Report
Instagram's Algorithm Reportedly Recommended Sexual Content to Teenagers' Accounts
Incidents involved as Deployer
Incidents implicated systems
Schools and teachers who were misinformed and burdened with COPPA compliance responsibilities without adequate disclosure
Afectado por Incidentes
Deepfake creators
Incidentes involucrados como desarrollador e implementador
Incidents involved as Deployer
Richland School District students
Afectado por Incidentes
- Incidente 8871 Report
Students of Richland School District in Cambria County, Pennsylvania Allegedly Used AI to Generate Obscene Images of Other Students
- Incidente 8871 Report
Students of Richland School District in Cambria County, Pennsylvania Allegedly Used AI to Generate Obscene Images of Other Students
Incidents involved as Deployer
- Incidente 8871 Report
Students of Richland School District in Cambria County, Pennsylvania Allegedly Used AI to Generate Obscene Images of Other Students
- Incidente 8871 Report
Students of Richland School District in Cambria County, Pennsylvania Allegedly Used AI to Generate Obscene Images of Other Students
Deepfake technology developers
Incidents involved as Developer
- Incidente 95811 Report
Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material
- Incidente 8917 Report
Purported AI Voice Scam Reportedly Targets Westchester Parents with Fake Kidnapping Ransom Calls
Incidents implicated systems
high school students
Afectado por Incidentes
- Incidente 137544 Report
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
- Incidente 8881 Report
Sydney High Schooler Allegedly Generated Deepfakes of Other Students
Incidents involved as Deployer
Epistemic integrity
Afectado por Incidentes
- Incidente 10094 Report
Purportedly AI-Assisted Report by Tromsø Officials Allegedly Cited Non-Existent Sources in School Closure Proposal
- Incidente 13423 Report
Purported Deepfake Nude Images of Students Circulated Without Consent at Valencia Educational Institute
Incidents implicated systems
Unknown CSAM apps
Incidents implicated systems
- Incidente 95811 Report
Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material
- Incidente 14482 Report
Ohio Man Pleaded Guilty after Prosecutors Alleged He Used AI to Create and Distribute Nonconsensual Intimate-Image Forgeries Including CSAM in Harassment Campaign
Character.ai
Incidentes involucrados como desarrollador e implementador
- Incidente 11082 Report
Digital Rights Groups Accuse Meta and Character.AI of Facilitating Unlicensed Therapy via Chatbots
- Incidente 12771 Report
Alleged Harmful Outputs and Data Exposure in Children's AI Products by FoloToy, Miko, and Character.AI
Incidents implicated systems
Gaggle
Incidentes involucrados como desarrollador e implementador
Incidents involved as Developer
Incidents implicated systems
- Incidente 11671 Report
Alleged Gaggle Surveillance Alert Reportedly Leads to Arrest and Detention of 13-Year-Old Student in Fairview, Tennessee
- Incidente 12151 Report
Gaggle Alert Reportedly Leads to Arrest of 15-Year-Old in Volusia County, Florida, for School Threat the Student Claimed Was Not Serious
Unknown actor(s) creating deepfake nudes of Sydney high school students
Incidents involved as Deployer
Waymo
Incidentes involucrados como desarrollador e implementador
- Incidente 13003 Report
Waymo Self-Driving Vehicles Reportedly Passed Stopped School Buses at Least 19 Times, Prompting NHTSA Probe
- Incidente 13612 Report
Waymo Autonomous Vehicle Reportedly Struck Child Near Elementary School in Santa Monica, California
Incidents implicated systems
Generative AI developers
Incidents involved as Developer
- Incidente 14482 Report
Ohio Man Pleaded Guilty after Prosecutors Alleged He Used AI to Create and Distribute Nonconsensual Intimate-Image Forgeries Including CSAM in Harassment Campaign
- Incidente 13181 Report
School's Suspected AI-Cheating Allegation Precedes Student's Reported Suicide in Greater Noida, India
Unknown generative AI systems
Incidents implicated systems
- Incidente 14482 Report
Ohio Man Pleaded Guilty after Prosecutors Alleged He Used AI to Create and Distribute Nonconsensual Intimate-Image Forgeries Including CSAM in Harassment Campaign
- Incidente 13181 Report
School's Suspected AI-Cheating Allegation Precedes Student's Reported Suicide in Greater Noida, India
Unnamed students at Mountain View Middle School
Afectado por Incidentes
Incidents involved as Deployer
Boys
Incidents involved as Deployer
- Incidente 13481 Report
Purported Deepfake Explicit Images of Middle School Students Allegedly Created and Circulated Using Mobile App in Goffstown, New Hampshire
- Incidente 13521 Report
Malaysian Teenager Allegedly Arrested for Creating and Selling AI-Generated Deepfake Images of Schoolmates and Alumni in Johor
Image generator technology
Incidents implicated systems
- Incidente 14393 Report
Former New Orleans Isidore Newman School Teacher Allegedly Used AI to Create Fake Nude Images from Social Media Photos of Girls, Including Students
- Incidente 13542 Report
Purportedly AI-Altered Fake Nude Images of High School Girls and Women Reportedly Created and Disseminated in Pensacola, Florida