Minors

Incidents Harmed By

Incident 137544 Report
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting

2026-02-10

After the 02/10/2026 school shooting in Tumbler Ridge, British Columbia, OpenAI said a user later identified as the suspect, Jesse Van Rootselaar, had previously used ChatGPT to describe scenarios involving gun violence. Those chats were reportedly auto-flagged and reviewed and the account was banned, but OpenAI says it did not alert the RCMP because it allegedly did not present a credible, imminent threat; the company reportedly contacted police after the attack.

Incident 62418 Report
Child Sexual Abuse Material Taints Image Generators

2023-12-20

The LAION-5B dataset (a commonly used dataset with more than 5 billion image-description pairs) was found by researchers to contain child sexual abuse material (CSAM), which increases the likelihood that downstream models will produce CSAM imagery. The discovery taints models built with the LAION dataset requiring many organizations to retrain those models. Additionally, LAION must now scrub the dataset of the imagery.

Incident 5516 Report
Alexa Plays Pornography Instead of Kids Song

2016-12-30

An Amazon Echo Dot using the Amazon Alex software started to play pornographic results when a child asked it to play a song.

Incident 114 Report
Google’s YouTube Kids App Presents Inappropriate Content

2015-05-19

YouTube’s content filtering and recommendation algorithms exposed children to disturbing and inappropriate videos.

Incident 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls

2023-11-01

From November 2023 through May 2024, two Lancaster Country Day School students in Pennsylvania allegedly used AI tools to create and exchange hundreds of sexualized deepfake images depicting female classmates and other girls. Authorities later identified 60 victims, 59 of them minors. The students were adjudicated delinquent in juvenile court, and families later sued the school and unnamed AI companies over the incident.

Incident 6172 Report
Male student allegedly used AI to generate nude photos of female classmates at a high school in Issaquah, Washington

2023-11-09

At a high school in Issaquah, Washington, a male student is reported to have used deepfake technology to alter pictures of several female classmates and then shared them.

Incident 14102 Report
Purportedly AI-Generated Explicit Images of Royal School Armagh Girls Reportedly Circulated Among Pupils

2026-01-17

Police in Northern Ireland reportedly investigated allegations that explicit purportedly AI-generated images of girls attending Royal School Armagh were created and shared among pupils. The images allegedly targeted multiple students and circulated within the school community.

Incident 16052 Report
Purportedly AI-Generated Image Prompted Emergency Investigation of False Fire at South Africa's Orlando West High School

2026-01-05

A purportedly AI-generated image reportedly depicting Orlando West High School of Soweto, South Africa, on fire circulated and was allegedly shared with emergency services. Johannesburg EMS reportedly investigated and visited the school, confirming that no fire had occurred. Officials said the false report caused public alarm and diverted emergency resources.

Minors

Incidents Harmed By

Incident 137544 ReportOpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting

Incident 62418 ReportChild Sexual Abuse Material Taints Image Generators

Incident 5516 ReportAlexa Plays Pornography Instead of Kids Song

Incident 114 ReportGoogle’s YouTube Kids App Presents Inappropriate Content

Incidents involved as Deployer

Incident 16238 ReportPennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls

Incident 6172 ReportMale student allegedly used AI to generate nude photos of female classmates at a high school in Issaquah, Washington

Incident 14102 ReportPurportedly AI-Generated Explicit Images of Royal School Armagh Girls Reportedly Circulated Among Pupils

Incident 16052 ReportPurportedly AI-Generated Image Prompted Emergency Investigation of False Fire at South Africa's Orlando West High School

Related Entities Related EntitiesOther entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.

Related Entities

YouTube

Incidents involved as both Developer and Deployer

Amazon

Incidents involved as both Developer and Deployer

International Baccalaureate Organization

Incidents involved as both Developer and Deployer

International Baccalaureate students

Incidents Harmed By

Students

Incidents Harmed By

Incidents involved as Deployer

Teachers

Incidents Harmed By

Incidents involved as Deployer

Parents

Incidents Harmed By

Educational communities

Incidents Harmed By

University applicants

Incidents Harmed By

International Baccalaureate 2020 calculated-grades model

Incidents implicated systems

Automated grading systems

Incidents implicated systems

Government of Argentina

Incidents involved as Deployer

Buenos Aires city government

Incidents involved as Deployer

Surveillance technology developers

Incidents involved as Developer

NtechLab

Incidents involved as Developer

Facial recognition system developers

Incidents involved as Developer

Danaide S.A.

Incidents involved as Developer

Privacy

Incidents Harmed By

General public of Buenos Aires

Incidents Harmed By

General public of Argentina

Incidents Harmed By

General public

Incidents Harmed By

Buenos Aires children

Incidents Harmed By

Biometric data subjects

Incidents Harmed By

UltraIP

Incidents implicated systems

Surveillance technology

Incidents implicated systems

Sistema de Reconocimiento Facial de Prófugos (SRFP)

Incidents implicated systems

Law enforcement facial recognition systems

Incidents implicated systems

Facial recognition systems

Incidents implicated systems

Consulta Nacional de Rebeldías y Capturas (CONARC)

Incidents implicated systems

Buenos Aires live facial recognition system

Incidents implicated systems

Biometric data processing systems

Incidents implicated systems

AI identification and tracking system

Incidents implicated systems

AI-enabled decision support systems

Incident 137544 Report
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting

Incident 62418 Report
Child Sexual Abuse Material Taints Image Generators

Incident 5516 Report
Alexa Plays Pornography Instead of Kids Song

Incident 114 Report
Google’s YouTube Kids App Presents Inappropriate Content

Incident 16238 Report
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls

Incident 6172 Report
Male student allegedly used AI to generate nude photos of female classmates at a high school in Issaquah, Washington

Incident 14102 Report
Purportedly AI-Generated Explicit Images of Royal School Armagh Girls Reportedly Circulated Among Pupils

Incident 16052 Report
Purportedly AI-Generated Image Prompted Emergency Investigation of False Fire at South Africa's Orlando West High School

Related Entities