Minors
影響を受けたインシデント
インシデント 137545 Report
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
2026-02-10
After the 02/10/2026 school shooting in Tumbler Ridge, British Columbia, OpenAI said a user later identified as the suspect, Jesse Van Rootselaar, had previously used ChatGPT to describe scenarios involving gun violence. Those chats were reportedly auto-flagged and reviewed and the account was banned, but OpenAI says it did not alert the RCMP because it allegedly did not present a credible, imminent threat; the company reportedly contacted police after the attack.
もっとインシデント 5127 Report
Security Robot Rolls Over Child in Mall
2016-07-12
On July 7, 2016, a Knightscope K5 autonomous security robot collided with a 16-month old boy while patrolling the Stanford Shopping Center in Palo Alto, CA.
もっとインシデント 62418 Report
Child Sexual Abuse Material Taints Image Generators
2023-12-20
The LAION-5B dataset (a commonly used dataset with more than 5 billion image-description pairs) was found by researchers to contain child sexual abuse material (CSAM), which increases the likelihood that downstream models will produce CSAM imagery. The discovery taints models built with the LAION dataset requiring many organizations to retrain those models. Additionally, LAION must now scrub the dataset of the imagery.
もっとインシデント 5516 Report
Alexa Plays Pornography Instead of Kids Song
2016-12-30
An Amazon Echo Dot using the Amazon Alex software started to play pornographic results when a child asked it to play a song.
もっとIncidents involved as Deployer
インシデント 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
2023-11-01
From November 2023 through May 2024, two Lancaster Country Day School students in Pennsylvania allegedly used AI tools to create and exchange hundreds of sexualized deepfake images depicting female classmates and other girls. Authorities later identified 60 victims, 59 of them minors. The students were adjudicated delinquent in juvenile court, and families later sued the school and unnamed AI companies over the incident.
もっとインシデント 16884 Report
Teenager in Quilmes, Argentina, Reportedly Consulted ChatGPT While Planning School Shooting Against Classmates
2026-08-19
Argentine authorities reported that a 15-year-old in Quilmes allegedly discussed a planned school shooting with ChatGPT, including tactical preparations, before an FBI alert prompted an investigation by the Argentine Federal Police. Police later seized phones and tactical clothing; no firearms or ammunition were reported. Public reporting does not establish what ChatGPT answered or whether it materially assisted the alleged plan.
もっとインシデント 17413 Report
ChatGPT Reportedly Helped a Texas High School Student Role-Play Shootings of His Teachers and Classmates
2026-05-02
ChatGPT reportedly helped a Texas high school student role-play shooting his teachers and classmates, using his school's layout and classmates' photos to advise on entry, exit, and police encounters. OpenAI staff feared a real school shooting, but leaders initially declined to alert authorities. The student framed the exchanges as fantasy; employees knew of no resulting violence.
もっとインシデント 17423 Report
ChatGPT Allegedly Helped a Teenager in Sarthe, France, Plan Terrorist Attacks on Schools and Government Buildings
2025-09-01
A 17-year-old student in Sarthe, France, allegedly used the AI chatbot ChatGPT to assist plans to burn schools and attack government buildings and embassies. Reported exchanges included explanations of explosion damage and security weaknesses, plus lyrics praising the Islamic State terrorist group. He alleged ChatGPT reinforced his radicalization; his lawyer confirmed AI influenced his behavior. Police arrested him before the plans were carried out.
もっと関連団体
同じインシデントに関連するその他のエンティティ。たとえば、インシデントの開発者がこのエンティティで、デプロイヤーが別のエンティティである場合、それらは関連エンティティとしてマークされます。
関連団体
Students
影響を受けたインシデント
- インシデント 137545 レポート
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
- インシデント 16238 レポート
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
Incidents involved as Deployer
Teachers
影響を受けたインシデント
- インシデント 137545 レポート
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
- インシデント 10094 レポート
Purportedly AI-Assisted Report by Tromsø Officials Allegedly Cited Non-Existent Sources in School Closure Proposal
Incidents involved as Deployer
Women
影響を受けたインシデント
- インシデント 1867 レポート
Algorithm Assessing Risk Faced by Victims of Gender Violence Misclassified Low-Risk Cases, Allegedly Leading to Homicide of Women and Children in Spain
- インシデント 14483 レポート
Ohio Man Pleaded Guilty after Prosecutors Alleged He Used AI to Create and Distribute Nonconsensual Intimate-Image Forgeries Including CSAM in Harassment Campaign
Law enforcement
Incidents involved as Deployer
- インシデント 4124 レポート
Finnish Police Were Reportedly Reprimanded After National Bureau of Investigation Unit Allegedly Used Clearview AI to Identify Potential Abuse Victims
- インシデント 16981 レポート
Flock Safety License-Plate Reader Reportedly Misread Plate Digit, Prompting Gunpoint Stop of Two Sisters in Española, New Mexico
Child sexual abuse victims
影響を受けたインシデント
- インシデント 95811 レポート
Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material
- インシデント 4124 レポート
Finnish Police Were Reportedly Reprimanded After National Bureau of Investigation Unit Allegedly Used Clearview AI to Identify Potential Abuse Victims
OpenAI
開発者と提供者の両方の立場で関わったインシデント
- インシデント 137545 レポート
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
- インシデント 11929 レポート
16-Year-Old Allegedly Received Suicide Method Guidance from ChatGPT Before Death
Incidents involved as Developer
Large language model developers
Incidents involved as Developer
- インシデント 137545 レポート
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
- インシデント 5135 レポート
ChatGPT Reportedly Banned by Italian Authority Due to OpenAI's Purported Lack of Legal Basis for Data Collection and Age Verification
Incidents implicated systems
Chatbot developers
Incidents involved as Developer
- インシデント 137545 レポート
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
- インシデント 5135 レポート
ChatGPT Reportedly Banned by Italian Authority Due to OpenAI's Purported Lack of Legal Basis for Data Collection and Age Verification
Incidents implicated systems
Synthetic image generation technology developers
Incidents involved as Developer
- インシデント 16238 レポート
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
- インシデント 16238 レポート
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
Incidents implicated systems
Social media users
影響を受けたインシデント
- インシデント 5613 レポート
OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent
- インシデント 11083 レポート
Digital Rights Groups Accuse Meta and Character.AI of Facilitating Unlicensed Therapy via Chatbots
Incidents involved as Deployer
開発者と提供者の両方の立場で関わったインシデント
- インシデント 5831 レポート
Instagram Algorithms Allegedly Promote Accounts Facilitating Child Sex Abuse Content
- インシデント 7881 レポート
Instagram's Algorithm Reportedly Recommended Sexual Content to Teenagers' Accounts
Incidents involved as Deployer
Incidents implicated systems
Adolescents
影響を受けたインシデント
- インシデント 17405 レポート
Teen Hiker Required Helicopter Rescue After Reportedly Following Claude Chatbot Directions in British Columbia, Canada
- インシデント 17464 レポート
Repeated Bomb Threat Calls, Some Reportedly AI-Generated, Disrupted Schools in Wheatland, California
Incidents involved as Deployer
Schools and teachers who were misinformed and burdened with COPPA compliance responsibilities without adequate disclosure
影響を受けたインシデント
High school students
影響を受けたインシデント
- インシデント 137545 レポート
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
- インシデント 17464 レポート
Repeated Bomb Threat Calls, Some Reportedly AI-Generated, Disrupted Schools in Wheatland, California
Incidents involved as Deployer
Boys
影響を受けたインシデント
- インシデント 15365 レポート
Humanoid Robot Identified as Likely Unitree G1 Reportedly Kicked Boy During Public Demonstration in Xinjiang
- インシデント 16914 レポート
ChatGPT Was Reportedly Used to Plan Zürich-Oerlikon Knife Attack That Seriously Injured Three Five-Year-Old Boys
Incidents involved as Deployer
Synthetic media generation technology developers
Incidents involved as Developer
- インシデント 16238 レポート
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
- インシデント 16238 レポート
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
Incidents implicated systems
Deepfake technology developers
Incidents involved as Developer
- インシデント 95811 レポート
Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material
- インシデント 16238 レポート
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
Incidents implicated systems
Victims of non-consensual deepfakes
影響を受けたインシデント
- インシデント 14393 レポート
Former New Orleans Isidore Newman School Teacher Allegedly Used AI to Create Fake Nude Images from Social Media Photos of Girls, Including Students
- インシデント 14483 レポート
Ohio Man Pleaded Guilty after Prosecutors Alleged He Used AI to Create and Distribute Nonconsensual Intimate-Image Forgeries Including CSAM in Harassment Campaign
Snapchat
開発者と提供者の両方の立場で関わったインシデント
- インシデント 5391 レポート
Snapchat's My AI Reported for Lacking Protection for Children
- インシデント 6461 レポート
Snapchat's Algorithm Alleged to Link Minor with Sex Offenders
Incidents implicated systems
Epistemic integrity
影響を受けたインシデント
- インシデント 95811 レポート
Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material
- インシデント 16238 レポート
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
Incidents implicated systems
Educators
影響を受けたインシデント
- インシデント 16884 レポート
Teenager in Quilmes, Argentina, Reportedly Consulted ChatGPT While Planning School Shooting Against Classmates
- インシデント 17464 レポート
Repeated Bomb Threat Calls, Some Reportedly AI-Generated, Disrupted Schools in Wheatland, California
Incidents involved as Deployer
Richland School District students
影響を受けたインシデント
- インシデント 8871 レポート
Students of Richland School District in Cambria County, Pennsylvania Allegedly Used AI to Generate Obscene Images of Other Students
- インシデント 8871 レポート
Students of Richland School District in Cambria County, Pennsylvania Allegedly Used AI to Generate Obscene Images of Other Students
Incidents involved as Deployer
Character.ai
開発者と提供者の両方の立場で関わったインシデント
- インシデント 12775 レポート
Alleged Harmful Outputs and Data Exposure in Children's AI Products by FoloToy, Miko, and Character.AI
- インシデント 11083 レポート
Digital Rights Groups Accuse Meta and Character.AI of Facilitating Unlicensed Therapy via Chatbots
Incidents implicated systems
Chatbot users
影響を受けたインシデント
- インシデント 11929 レポート
16-Year-Old Allegedly Received Suicide Method Guidance from ChatGPT Before Death
- インシデント 12001 レポート
Meta AI on Instagram Reportedly Facilitated Suicide and Eating Disorder Roleplay with Teen Accounts
Incidents involved as Developer
Incidents involved as Deployer
Unknown actor(s) creating deepfake nudes of Sydney high school students
Incidents involved as Deployer
Omnilert
Incidents involved as Developer
- インシデント 12503 レポート
Alleged False Positive by Omnilert AI Gun Detection System Prompts Police Search at Baltimore County High School
- インシデント 12671 レポート
Omnilert AI Reportedly Triggered False Gun Alert at Parkville High, Prompting Student Relocation
Incidents implicated systems
Waymo
開発者と提供者の両方の立場で関わったインシデント
- インシデント 13003 レポート
Waymo Self-Driving Vehicles Reportedly Passed Stopped School Buses at Least 19 Times, Prompting NHTSA Probe
- インシデント 13612 レポート
Waymo Autonomous Vehicle Reportedly Struck Child Near Elementary School in Santa Monica, California
Incidents implicated systems
Unnamed students at Western Dubuque Community School District
影響を受けたインシデント
Incidents involved as Deployer
Lake Zurich High School students
影響を受けたインシデント
- インシデント 15741 レポート
Purportedly AI-Generated Explicit Images of Students Allegedly Circulated at Lake Zurich High School in Illinois
- インシデント 15741 レポート
Purportedly AI-Generated Explicit Images of Students Allegedly Circulated at Lake Zurich High School in Illinois