AI content detection models
Incidents implicated systems
Incident 13491 Report
AI Training Dataset for Detecting Nudity Allegedly Found to Contain CSAM Images of Identified Victims
2025-10-24
An image dataset, NudeNet, used to train systems for detecting nudity was reportedly found to contain CSAM images, including material involving identified or known victims. According to the Canadian Centre for Child Protection, the dataset had been widely downloaded and cited in academic research prior to discovery. The images were allegedly included without vetting, exposing researchers to legal risk and perpetuating harm to victims. The dataset was subsequently removed following notification.
MoreIncident 16321 Report
Yale Student Suspended and Given F After GPTZero Allegedly Misclassified Exam as AI-Generated
2024-06-11
In 2024, Yale University reportedly used GPTZero as one factor in investigating whether Executive MBA student Thierry Rignol used AI on an exam. Rignol reportedly denied cheating and alleged the detector falsely classified his writing as AI-generated. Yale reportedly later suspended him for a year and gave him an F, while citing additional evidence and his conduct during the investigation. Rignol has challenged the process in federal court.
More