Privacy
Incidents Harmed By
Incident 132928 Report
Grok Reportedly Generated and Distributed Nonconsensual Sexualized Images of Adults and Minors in X Replies
2025-12-25
Grok reportedly generated and publicly distributed nonconsensual sexualized images of real people, including adults and minors, through reply prompts on the platform. Users reportedly prompted Grok to alter photos into sexually explicit content, which was then posted in X threads, exposing victims to harm.
MoreIncident 84216 Report
Reportedly Hacked AI-Powered Robot Vacuums Allegedly Used for Surveillance and Harassment
2024-05-24
Hackers reportedly exploited a vulnerability in Ecovacs’s Deebot X2 robot vacuums, gaining unauthorized access to camera and microphone controls. Users reported privacy invasions and offensive language broadcasted through the devices. Although Ecovacs claimed to have resolved the security flaw, researchers suggest vulnerabilities remain that could potentially leave users exposed to surveillance and harassment through their AI-enabled devices.
MoreIncident 141816 Report
Meta AI Smart Glasses Reportedly Routed Intimate Imagery to Reviewers at Kenyan Contractor Sama Before Meta Ended Contract
2026-02-27
Meta AI smart glasses reportedly sent media and transcripts from AI interactions to Sama contractors in Kenya for human review. Workers said they saw nudity, bathroom use, sex, bank cards, and other private activity, sometimes involving people unaware they were recorded or faces left visible despite filtering. The reports prompted lawsuits and regulatory inquiries before Meta paused the work and ended its Sama contract, affecting 1,108 workers.
MoreIncident 107515 Report
New Orleans Police Reportedly Used Real-Time Facial Recognition Alerts Supplied by Project NOLA Despite Local Ordinance
2025-05-19
According to reporting by The Washington Post, New Orleans police received real-time facial recognition alerts from a privately operated surveillance network run by Project NOLA, reportedly leading to dozens of arrests. This purported use of AI surveillance appears to conflict with a 2022 city ordinance that restricts facial recognition to specific post-incident investigations. Police are alleged to have not consistently disclosed the technology's use.
MoreRelated Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
Related Entities
Law enforcement
Incidents Harmed By
- Incident 15953 Reports
Deputies in Cherokee County, Georgia, Allegedly Misused Automated License Plate Reader Data for Non-Law-Enforcement Purposes
- Incident 16152 Reports
Scammers Allegedly Used AI-Generated Voice in Boone County, Missouri, Kidnapping Ransom Scam
Incidents involved as Deployer
- Incident 4124 Reports
Finnish Police Were Reportedly Reprimanded After National Bureau of Investigation Unit Allegedly Used Clearview AI to Identify Potential Abuse Victims
- Incident 15953 Reports
Deputies in Cherokee County, Georgia, Allegedly Misused Automated License Plate Reader Data for Non-Law-Enforcement Purposes
Clearview AI
Incidents involved as both Developer and Deployer
Incidents involved as Developer
- Incident 4124 Reports
Finnish Police Were Reportedly Reprimanded After National Bureau of Investigation Unit Allegedly Used Clearview AI to Identify Potential Abuse Victims
- Incident 5583 Reports
Activists Allege NYPD's Application of Facial Recognition Interfered with Right to Protest
Incidents implicated systems
Minors
Incidents Harmed By
- Incident 16238 Reports
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
- Incident 5135 Reports
ChatGPT Reportedly Banned by Italian Authority Due to OpenAI's Purported Lack of Legal Basis for Data Collection and Age Verification
Incidents involved as Deployer
Biometric data subjects
Incidents Harmed By
- Incident 4415 Reports
South Korean Agencies Reportedly Shared Airport Travelers' Face Images with Companies to Train Immigration Facial Recognition System
- Incident 4124 Reports
Finnish Police Were Reportedly Reprimanded After National Bureau of Investigation Unit Allegedly Used Clearview AI to Identify Potential Abuse Victims
Law enforcement facial recognition systems
Incidents implicated systems
- Incident 4124 Reports
Finnish Police Were Reportedly Reprimanded After National Bureau of Investigation Unit Allegedly Used Clearview AI to Identify Potential Abuse Victims
- Incident 15452 Reports
Florida Police Reportedly Wrongfully Arrested Commercial Crabber Robert Dillon After Allegedly False Facial Recognition Match
Facial recognition systems
Incidents implicated systems
- Incident 4415 Reports
South Korean Agencies Reportedly Shared Airport Travelers' Face Images with Companies to Train Immigration Facial Recognition System
- Incident 4124 Reports
Finnish Police Were Reportedly Reprimanded After National Bureau of Investigation Unit Allegedly Used Clearview AI to Identify Potential Abuse Victims
Students
Incidents Harmed By
- Incident 16238 Reports
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls
- Incident 4244 Reports
Canadian Universities' AI Proctoring Tools Reportedly Collected Student Biometric Data Without Adequate Consent
Incidents involved as Deployer
Surveillance technology developers
Incidents involved as both Developer and Deployer
Incidents involved as Developer
Incidents involved as both Developer and Deployer
- Incident 4651 Report
Private Medical Photos Were Reportedly Found in LAION-5B AI Training Dataset
- Incident 7431 Report
Gemini AI Allegedly Reads Google Drive Files Without Explicit User Consent
Incidents involved as Developer
- Incident 15892 Reports
Purportedly AI-Powered 007TG Platform Reportedly Used by Scam Networks Linked to $75 Million in Proceeds
- Incident 15071 Report
COEMPT Quality Assurance Engineers Allegedly Violated Indian CBSE Student Data Privacy Rights by Processing It with Google Gemini
Incidents implicated systems
OpenAI
Incidents involved as both Developer and Deployer
- Incident 5135 Reports
ChatGPT Reportedly Banned by Italian Authority Due to OpenAI's Purported Lack of Legal Basis for Data Collection and Age Verification
- Incident 11865 Reports
Reported Public Exposure of Over 100,000 LLM Conversations via Share Links Indexed by Search Engines and Archived
Incidents involved as Developer
ChatGPT
Incidents involved as Deployer
Incidents implicated systems
- Incident 9396 Reports
AI-Powered Chinese Surveillance Campaign 'Peer Review' Used for Real-Time Monitoring of Anti-State Speech on Western Social Media
- Incident 5135 Reports
ChatGPT Reportedly Banned by Italian Authority Due to OpenAI's Purported Lack of Legal Basis for Data Collection and Age Verification
Microsoft
Incidents involved as both Developer and Deployer
- Incident 11865 Reports
Reported Public Exposure of Over 100,000 LLM Conversations via Share Links Indexed by Search Engines and Archived
- Incident 11742 Reports
Microsoft Copilot Reportedly Able to Access Cached Data from Since-Private GitHub Repositories
Incidents Harmed By
Incidents involved as Deployer
Teachers
Incidents Harmed By
- Incident 16122 Reports
A.B. Paterson College Teacher in Queensland Allegedly Used AI to Create Explicit Images of Students and Staff
- Incident 5861 Report
FTC Targets Edmodo for Unlawful Use of Children’s Data and Delegating Compliance to Schools
Incidents involved as Deployer
Schools and teachers who were misinformed and burdened with COPPA compliance responsibilities without adequate disclosure
Incidents Harmed By
Replika
Incidents involved as both Developer and Deployer
- Incident 6365 Reports
AI Romance Apps Reportedly Compromise User Privacy for Data Harvesting
- Incident 4911 Report
Replika's AI Experience Reportedly Lacked Protection for Minors, Resulting in Data Ban
Incidents implicated systems
Genesia AI Friend & Partner
Incidents involved as both Developer and Deployer
Incidents implicated systems
EVA AI Chat Bot & Soulmate
Incidents involved as both Developer and Deployer
Incidents implicated systems
End users of undisclosed Middle Eastern AI-powered cloud call center platform
Incidents Harmed By
Meta
Incidents involved as both Developer and Deployer
- Incident 141816 Reports
Meta AI Smart Glasses Reportedly Routed Intimate Imagery to Reviewers at Kenyan Contractor Sama Before Meta Ended Contract
- Incident 12775 Reports
Alleged Harmful Outputs and Data Exposure in Children's AI Products by FoloToy, Miko, and Character.AI
Incidents Harmed By
Incidents involved as Developer
Serbian Security Information Agency (BIA)
Incidents involved as both Developer and Deployer
Real-time facial recognition alert pipeline to New Orleans Police Department
Incidents implicated systems
Automated person-tracking via clothing and physical descriptors
Incidents implicated systems
Gaggle
Incidents involved as Developer
- Incident 11671 Report
Alleged Gaggle Surveillance Alert Reportedly Leads to Arrest and Detention of 13-Year-Old Student in Fairview, Tennessee
- Incident 12131 Report
Gaggle AI Monitoring at Lawrence, Kansas High School Reportedly Misflags Student Content and Blocks Emails
Incidents implicated systems
Tea Dating Advice
Incidents involved as both Developer and Deployer
Incidents implicated systems
xAI
Incidents involved as both Developer and Deployer
- Incident 132928 Reports
Grok Reportedly Generated and Distributed Nonconsensual Sexualized Images of Adults and Minors in X Replies
- Incident 11865 Reports
Reported Public Exposure of Over 100,000 LLM Conversations via Share Links Indexed by Search Engines and Archived
Incidents involved as Developer
Secret Desires
Incidents involved as both Developer and Deployer
Incidents implicated systems
Unknown threat actors distributing malicious OpenClaw skills
Incidents involved as Deployer
Automated license plate readers (ALPR)
Incidents implicated systems
- Incident 15953 Reports
Deputies in Cherokee County, Georgia, Allegedly Misused Automated License Plate Reader Data for Non-Law-Enforcement Purposes
- Incident 13901 Report
DHS Agents Reportedly Threatened Legal Observers With 'Domestic Terrorist' Database While Using Purportedly AI-Enabled Surveillance During ICE Operations