Minors
影響を受けたインシデント
インシデント 137544 Report
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
2026-02-10
After the 02/10/2026 school shooting in Tumbler Ridge, British Columbia, OpenAI said a user later identified as the suspect, Jesse Van Rootselaar, had previously used ChatGPT to describe scenarios involving gun violence. Those chats were reportedly auto-flagged and reviewed and the account was banned, but OpenAI says it did not alert the RCMP because it allegedly did not present a credible, imminent threat; the company reportedly contacted police after the attack.
もっとインシデント 62418 Report
Child Sexual Abuse Material Taints Image Generators
2023-12-20
The LAION-5B dataset (a commonly used dataset with more than 5 billion image-description pairs) was found by researchers to contain child sexual abuse material (CSAM), which increases the likelihood that downstream models will produce CSAM imagery. The discovery taints models built with the LAION dataset requiring many organizations to retrain those models. Additionally, LAION must now scrub the dataset of the imagery.
もっとインシデント 5516 Report
Alexa Plays Pornography Instead of Kids Song
2016-12-30
An Amazon Echo Dot using the Amazon Alex software started to play pornographic results when a child asked it to play a song.
もっとインシデント 114 Report
Google’s YouTube Kids App Presents Inappropriate Content
2015-05-19
YouTube’s content filtering and recommendation algorithms exposed children to disturbing and inappropriate videos.
もっとIncidents involved as Deployer
インシデント 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
2023-11-01
From November 2023 through May 2024, two Lancaster Country Day School students in Pennsylvania allegedly used AI tools to create and exchange hundreds of sexualized deepfake images depicting female classmates and other girls. Authorities later identified 60 victims, 59 of them minors. The students were adjudicated delinquent in juvenile court, and families later sued the school and unnamed AI companies over the incident.
もっとインシデント 16884 Report
Teenager in Quilmes, Argentina, Reportedly Consulted ChatGPT While Planning School Shooting Against Classmates
2026-08-19
Argentine authorities reported that a 15-year-old in Quilmes allegedly discussed a planned school shooting with ChatGPT, including tactical preparations, before an FBI alert prompted an investigation by the Argentine Federal Police. Police later seized phones and tactical clothing; no firearms or ammunition were reported. Public reporting does not establish what ChatGPT answered or whether it materially assisted the alleged plan.
もっとインシデント 6172 Report
Male student allegedly used AI to generate nude photos of female classmates at a high school in Issaquah, Washington
2023-11-09
At a high school in Issaquah, Washington, a male student is reported to have used deepfake technology to alter pictures of several female classmates and then shared them.
もっとインシデント 14102 Report
Purportedly AI-Generated Explicit Images of Royal School Armagh Girls Reportedly Circulated Among Pupils
2026-01-17
Police in Northern Ireland reportedly investigated allegations that explicit purportedly AI-generated images of girls attending Royal School Armagh were created and shared among pupils. The images allegedly targeted multiple students and circulated within the school community.
もっと関連団体
同じインシデントに関連するその他のエンティティ。たとえば、インシデントの開発者がこのエンティティで、デプロイヤーが別のエンティティである場合、それらは関連エンティティとしてマークされます。
関連団体
Students
影響を受けたインシデント
- インシデント 137544 レポート
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
- インシデント 16238 レポート
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
Incidents involved as Deployer
Teachers
影響を受けたインシデント
- インシデント 137544 レポート
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
- インシデント 10094 レポート
Purportedly AI-Assisted Report by Tromsø Officials Allegedly Cited Non-Existent Sources in School Closure Proposal
Incidents involved as Deployer
Women
影響を受けたインシデント
- インシデント 1867 レポート
Algorithm Assessing Risk Faced by Victims of Gender Violence Misclassified Low-Risk Cases, Allegedly Leading to Homicide of Women and Children in Spain
- インシデント 14483 レポート
Ohio Man Pleaded Guilty after Prosecutors Alleged He Used AI to Create and Distribute Nonconsensual Intimate-Image Forgeries Including CSAM in Harassment Campaign
Law enforcement
Incidents involved as Deployer
- インシデント 4124 レポート
Finnish Police Were Reportedly Reprimanded After National Bureau of Investigation Unit Allegedly Used Clearview AI to Identify Potential Abuse Victims
- インシデント 16981 レポート
Flock Safety License-Plate Reader Reportedly Misread Plate Digit, Prompting Gunpoint Stop of Two Sisters in Española, New Mexico
Child sexual abuse victims
影響を受けたインシデント
- インシデント 95811 レポート
Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material
- インシデント 4124 レポート
Finnish Police Were Reportedly Reprimanded After National Bureau of Investigation Unit Allegedly Used Clearview AI to Identify Potential Abuse Victims
OpenAI
開発者と提供者の両方の立場で関わったインシデント
- インシデント 137544 レポート
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
- インシデント 11929 レポート
16-Year-Old Allegedly Received Suicide Method Guidance from ChatGPT Before Death
Incidents involved as Developer
Large language model developers
Incidents involved as Developer
- インシデント 137544 レポート
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
- インシデント 5135 レポート
ChatGPT Reportedly Banned by Italian Authority Due to OpenAI's Purported Lack of Legal Basis for Data Collection and Age Verification
Incidents implicated systems
Chatbot developers
Incidents involved as Developer
- インシデント 137544 レポート
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
- インシデント 5135 レポート
ChatGPT Reportedly Banned by Italian Authority Due to OpenAI's Purported Lack of Legal Basis for Data Collection and Age Verification
Incidents implicated systems
Synthetic image generation technology developers
Incidents involved as Developer
- インシデント 16238 レポート
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
- インシデント 16238 レポート
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
Incidents implicated systems
Social media users
影響を受けたインシデント
- インシデント 5613 レポート
OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent
- インシデント 11083 レポート
Digital Rights Groups Accuse Meta and Character.AI of Facilitating Unlicensed Therapy via Chatbots
Incidents involved as Deployer
開発者と提供者の両方の立場で関わったインシデント
- インシデント 5831 レポート
Instagram Algorithms Allegedly Promote Accounts Facilitating Child Sex Abuse Content
- インシデント 7881 レポート
Instagram's Algorithm Reportedly Recommended Sexual Content to Teenagers' Accounts
Incidents involved as Deployer
Incidents implicated systems
Adolescents
影響を受けたインシデント
- インシデント 16793 レポート
Lyft Driver in Boca Raton, Florida, Allegedly Used Purported Google Gemini-Generated Image to Support False $75 Damage Fee
- インシデント 15922 レポート
Purportedly AI-Generated Images Reportedly Used During Four-Year Catfishing Campaign Targeting Welsh Teenager
Incidents involved as Deployer
Schools and teachers who were misinformed and burdened with COPPA compliance responsibilities without adequate disclosure
影響を受けたインシデント
High school students
影響を受けたインシデント
- インシデント 137544 レポート
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
- インシデント 12503 レポート
Alleged False Positive by Omnilert AI Gun Detection System Prompts Police Search at Baltimore County High School
Incidents involved as Deployer
Boys
影響を受けたインシデント
- インシデント 15365 レポート
Humanoid Robot Identified as Likely Unitree G1 Reportedly Kicked Boy During Public Demonstration in Xinjiang
- インシデント 16914 レポート
ChatGPT Was Reportedly Used to Plan Zürich-Oerlikon Knife Attack That Seriously Injured Three Five-Year-Old Boys
Incidents involved as Deployer
Synthetic media generation technology developers
Incidents involved as Developer
- インシデント 16238 レポート
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
- インシデント 16238 レポート
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
Incidents implicated systems
Deepfake technology developers
Incidents involved as Developer
- インシデント 95811 レポート
Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material
- インシデント 16238 レポート
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
Incidents implicated systems
Victims of non-consensual deepfakes
影響を受けたインシデント
- インシデント 14393 レポート
Former New Orleans Isidore Newman School Teacher Allegedly Used AI to Create Fake Nude Images from Social Media Photos of Girls, Including Students
- インシデント 14483 レポート
Ohio Man Pleaded Guilty after Prosecutors Alleged He Used AI to Create and Distribute Nonconsensual Intimate-Image Forgeries Including CSAM in Harassment Campaign
Snapchat
開発者と提供者の両方の立場で関わったインシデント
- インシデント 5391 レポート
Snapchat's My AI Reported for Lacking Protection for Children
- インシデント 6461 レポート
Snapchat's Algorithm Alleged to Link Minor with Sex Offenders
Incidents implicated systems
Epistemic integrity
影響を 受けたインシデント
- インシデント 95811 レポート
Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material
- インシデント 16238 レポート
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
Incidents implicated systems
Educators
影響を受けたインシデント
- インシデント 16884 レポート
Teenager in Quilmes, Argentina, Reportedly Consulted ChatGPT While Planning School Shooting Against Classmates
- インシデント 16884 レポート
Teenager in Quilmes, Argentina, Reportedly Consulted ChatGPT While Planning School Shooting Against Classmates
Incidents involved as Deployer
Richland School District students
影響を受けたインシデント
- インシデント 8871 レポート
Students of Richland School District in Cambria County, Pennsylvania Allegedly Used AI to Generate Obscene Images of Other Students
- インシデント 8871 レポート
Students of Richland School District in Cambria County, Pennsylvania Allegedly Used AI to Generate Obscene Images of Other Students
Incidents involved as Deployer
Character.ai
開発者と提供者の両方の立場で関わったインシデント
- インシデント 12775 レポート
Alleged Harmful Outputs and Data Exposure in Children's AI Products by FoloToy, Miko, and Character.AI
- インシデント 11083 レポート
Digital Rights Groups Accuse Meta and Character.AI of Facilitating Unlicensed Therapy via Chatbots
Incidents implicated systems
Chatbot users
影響を受けたインシデント
- インシデント 11929 レポート
16-Year-Old Allegedly Received Suicide Method Guidance from ChatGPT Before Death
- インシデント 12001 レポート
Meta AI on Instagram Reportedly Facilitated Suicide and Eating Disorder Roleplay with Teen Accounts
Incidents involved as Developer
Incidents involved as Deployer
Unknown actor(s) creating deepfake nudes of Sydney high school students
Incidents involved as Deployer
Omnilert
Incidents involved as Developer
- インシデント 12503 レポート
Alleged False Positive by Omnilert AI Gun Detection System Prompts Police Search at Baltimore County High School
- インシデント 12671 レポート
Omnilert AI Reportedly Triggered False Gun Alert at Parkville High, Prompting Student Relocation
Incidents implicated systems
Waymo
開発者と提供者の両方の立場で関わったインシデント
- インシデント 13003 レポート
Waymo Self-Driving Vehicles Reportedly Passed Stopped School Buses at Least 19 Times, Prompting NHTSA Probe
- インシデント 13612 レポート
Waymo Autonomous Vehicle Reportedly Struck Child Near Elementary School in Santa Monica, California
Incidents implicated systems
Unnamed students at Western Dubuque Community School District
影響を受けたインシデント
Incidents involved as Deployer
Lake Zurich High School students
影響を受けたインシデント
- インシデント 15741 レポート
Purportedly AI-Generated Explicit Images of Students Allegedly Circulated at Lake Zurich High School in Illinois
- インシデント 15741 レポート
Purportedly AI-Generated Explicit Images of Students Allegedly Circulated at Lake Zurich High School in Illinois