Minors
影響を受けたインシデント
インシデント 137544 Report
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
2026-02-10
After the 02/10/2026 school shooting in Tumbler Ridge, British Columbia, OpenAI said a user later identified as the suspect, Jesse Van Rootselaar, had previously used ChatGPT to describe scenarios involving gun violence. Those chats were reportedly auto-flagged and reviewed and the account was banned, but OpenAI says it did not alert the RCMP because it allegedly did not present a credible, imminent threat; the company reportedly contacted police after the attack.
もっとインシデント 62418 Report
Child Sexual Abuse Material Taints Image Generators
2023-12-20
The LAION-5B dataset (a commonly used dataset with more than 5 billion image-description pairs) was found by researchers to contain child sexual abuse material (CSAM), which increases the likelihood that downstream models will produce CSAM imagery. The discovery taints models built with the LAION dataset requiring many organizations to retrain those models. Additionally, LAION must now scrub the dataset of the imagery.
もっとインシデント 5516 Report
Alexa Plays Pornography Instead of Kids Song
2016-12-30
An Amazon Echo Dot using the Amazon Alex software started to play pornographic results when a child asked it to play a song.
もっとインシデント 114 Report
Google’s YouTube Kids App Presents Inappropriate Content
2015-05-19
YouTube’s content filtering and recommendation algorithms exposed children to disturbing and inappropriate videos.
もっとIncidents involved as Deployer
インシデント 8871 Report
Students of Richland School District in Cambria County, Pennsylvania Allegedly Used AI to Generate Obscene Images of Other Students
2024-11-14
The Richland School District (Cambria County, Pennsylvania) released a statement on November 19, 2024 announcing an investigation into "some secondary students" who are alleged to have used AI to "create and electronically distribute obscene images of Richland students." The school administrators became aware of the incident on November 14, 2024.
もっとインシデント 9451 Report
Two 16-Year-Old Students in Athens, Greece Allegedly Generated Nonconsensual Deepfake Pornography of Their Classmates
2025-02-19
In Athens, Greece, two 16-year-old students were arrested for allegedly generated nonconsensual deepfake pornography of their classmates. They reportedly used images taken from social media to create the explicit images, which they are then reported to have disseminated online to others. The parents of the students were reportedly also arrested for neglecting to supervise their behavior.
もっとインシデント 14741 Report
Tasmanian School Students Reportedly Created Purported AI-Generated Pornographic Images of Female Classmates
2026-04-01
Five boys at The Friends' School in Hobart, Tasmania allegedly created purported AI-generated pornographic images using photos of female classmates, with parents saying 21 girls were identified as victims. The images were reportedly shared in a boys' group chat. Tasmania Police said no charges had been laid and the youths were being dealt with under the Youth Justice Act.
もっと関連団体
同じインシデントに関連するその他のエンティティ。たとえば、インシデントの開発者がこのエンティティで、デプ ロイヤーが別のエンティティである場合、それらは関連エンティティとしてマークされます。
関連団体
Students
影響を受けたインシデント
- インシデント 137544 レポート
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
- インシデント 8917 レポート
Purported AI Voice Scam Reportedly Targets Westchester Parents with Fake Kidnapping Ransom Calls
Incidents involved as Deployer
Teachers
影響を受けたインシデント
- インシデント 137544 レポート
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
- インシデント 10094 レポート
Purportedly AI-Assisted Report by Tromsø Officials Allegedly Cited Non-Existent Sources in School Closure Proposal
Incidents involved as Deployer
Women
影響を受けたインシデント
- インシデント 1867 レポート
Algorithm Assessing Risk Faced by Victims of Gender Violence Misclassified Low-Risk Cases, Allegedly Leading to Homicide of Women and Children in Spain
- インシデント 14482 レポート
Ohio Man Pleaded Guilty after Prosecutors Alleged He Used AI to Create and Distribute Nonconsensual Intimate-Image Forgeries Including CSAM in Harassment Campaign
Child sexual abuse victims
影響を受けたインシデント
- インシデント 95811 レポート
Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material
- インシデント 4124 レポート
Finnish Police Were Reportedly Reprimanded After National Bureau of Investigation Unit Allegedly Used Clearview AI to Identify Potential Abuse Victims
Privacy
影響を受けたインシデント
- インシデント 5135 レポート
ChatGPT Reportedly Banned by Italian Authority Due to OpenAI's Purported Lack of Legal Basis for Data Collection and Age Verification
- インシデント 4124 レポート
Finnish Police Were Reportedly Reprimanded After National Bureau of Investigation Unit Allegedly Used Clearview AI to Identify Potential Abuse Victims
OpenAI
開発者と提供者の両方の立場で関わったインシデント
- インシデント 137544 レポート
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
- インシデント 11928 レポート
16-Year-Old Allegedly Received Suicide Method Guidance from ChatGPT Before Death
Incidents involved as Developer
Snapchat
開発者と提供者の両方の立場で関わったインシデント
- インシデント 5391 レポート
Snapchat's My AI Reported for Lacking Protection for Children
- インシデント 6461 レポート
Snapchat's Algorithm Alleged to Link Minor with Sex Offenders
Incidents implicated systems
Meta
開発者と提供者の両方の立場で関わったインシデント
- インシデント 7232 レポート
Instagram Algorithms Reportedly Directed Children's Merchandise Ad Campaign to Adult Men and Sex Offenders
- インシデント 10402 レポート
Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas
Incidents implicated systems
開発者と提供者の両方の立場で関わったインシデント
- インシデント 5831 レポート
Instagram Algorithms Allegedly Promote Accounts Facilitating Child Sex Abuse Content
- インシデント 7881 レポート
Instagram's Algorithm Reportedly Recommended Sexual Content to Teenagers' Accounts
Incidents involved as Deployer
Incidents implicated systems
Schools and teachers who were misinformed and burdened with COPPA compliance responsibilities without adequate disclosure
影響を受けたインシデント
Richland School District students
影響を受けたインシデント
- インシデント 8871 レポート
Students of Richland School District in Cambria County, Pennsylvania Allegedly Used AI to Generate Obscene Images of Other Students
- インシデント 8871 レポート
Students of Richland School District in Cambria County, Pennsylvania Allegedly Used AI to Generate Obscene Images of Other Students
Incidents involved as Deployer
Deepfake technology developers
Incidents involved as Developer
- インシデント 95811 レポート
Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material
- インシデント 8917 レポート
Purported AI Voice Scam Reportedly Targets Westchester Parents with Fake Kidnapping Ransom Calls
Incidents implicated systems
high school students
影響を受けたインシデント
- インシデント 137544 レポート
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
- インシデント 8881 レポート
Sydney High Schooler Allegedly Generated Deepfakes of Other Students
Incidents involved as Deployer
Epistemic integrity
影響を受けたインシデント
- インシデント 95811 レポート
Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material
- インシデント 10094 レポート
Purportedly AI-Assisted Report by Tromsø Officials Allegedly Cited Non-Existent Sources in School Closure Proposal
Incidents implicated systems
Deepfake CSAM technology
Incidents involved as Developer
Incidents implicated systems
- インシデント 95811 レポート
Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material
- インシデント 14482 レポート
Ohio Man Pleaded Guilty after Prosecutors Alleged He Used AI to Create and Distribute Nonconsensual Intimate-Image Forgeries Including CSAM in Harassment Campaign
Character.ai
開発者と提供者の両方の立場で関わったインシデント
- インシデント 11082 レポート
Digital Rights Groups Accuse Meta and Character.AI of Facilitating Unlicensed Therapy via Chatbots
- インシデント 12771 レポート
Alleged Harmful Outputs and Data Exposure in Children's AI Products by FoloToy, Miko, and Character.AI
Incidents implicated systems
Unknown actor(s) creating deepfake nudes of Sydney high school students
Incidents involved as Deployer
Waymo
開発者と提供者の両方の立場で関わったインシデント
- インシデント 13003 レポート
Waymo Self-Driving Vehicles Reportedly Passed Stopped School Buses at Least 19 Times, Prompting NHTSA Probe
- インシデント 13612 レポート
Waymo Autonomous Vehicle Reportedly Struck Child Near Elementary School in Santa Monica, California