Enterprise AI systems
Incidents implicated systems
Incident 3734 Report
Amazon’s Experimental Hiring Tool Allegedly Displayed Gender Bias in Candidate Rankings
2016-08-10
Between 2014 and 2017, Amazon reportedly developed an AI-powered recruiting tool to score job applicants, trained on a decade of resumes purportedly drawn largely from men. Media reports say the system learned to favor male candidates, penalizing terms like "women's" and graduates from certain all-women's colleges. Efforts to remove these biases reportedly did not guarantee fairness, and the project was ultimately abandoned. Amazon reportedly states recruiters never solely relied on the tool.
MoreIncident 60821 Report
UnitedHealth Accused of Deploying Allegedly Flawed AI to Deny Medical Coverage
2023-02-28
UnitedHealthcare allegedly used a faulty AI algorithm with a 90% error rate to override doctors' recommendations and deny health coverage. This AI, developed by NaviHealth, reportedly led to premature discharge from care facilities and substantial out-of-pocket expenses for patients, according to a lawsuit filed in the District Court for Minnesota.
MoreIncident 107014 Report
Serviceaide AI Platform Implicated in Health Data Exposure Affecting 483,000 Catholic Health Patients
2025-05-09
An AI-linked platform operated by Serviceaide exposed sensitive health data from Catholic Health, affecting 483,000 patients. The breach stemmed from a misconfigured Elasticsearch database used in Serviceaide’s agentic AI infrastructure. Exposed information included medical records, insurance details, and login credentials. While no misuse has been confirmed, the nature of the data has prompted regulatory scrutiny and legal investigations.
MoreIncident 109 Report
Kronos Scheduling Algorithm Allegedly Caused Financial Issues for Starbucks Employees
2014-08-14
Kronos’s scheduling algorithm and its use by Starbucks managers allegedly negatively impacted financial and scheduling stability for Starbucks employees, which disadvantaged wage workers.
MoreRelated Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
Related Entities
Associated machine learning models trained on historical Amazon resume data
Incidents implicated systems
Employees
Incidents Harmed By
- Incident 8116 Reports
AI-Powered Transcription Services Allegedly Leak Confidential Workplace Discussions
- Incident 16504 Reports
Otter.ai Notetaker Allegedly Recorded Meeting Conversations Without Participants' Informed Consent and Used Data for AI Training
Incidents involved as Deployer
Companies
Incidents Harmed By
- Incident 8116 Reports
AI-Powered Transcription Services Allegedly Leak Confidential Workplace Discussions
- Incident 16624 Reports
Pizza Hut Franchisee Chaac Pizza Northeast Alleged Dragontail AI System Contributed to Delivery Delays and $100 Million in Losses
Incidents involved as Deployer
Otter.ai
Incidents involved as both Developer and Deployer
Incidents involved as Developer
Incidents implicated systems
End users of undisclosed Middle Eastern AI-powered cloud call center platform
Incidents Harmed By
Cursor
Incidents involved as Developer
Incidents involved as Deployer
Incidents implicated systems
Unspecified developer of aerial imagery risk analysis system
Incidents involved as Developer
Amazon Q AI coding assistant (AWS Toolkit for Visual Studio Code)
Incidents implicated systems
Meta
Incidents involved as both Developer and Deployer
- Incident 15843 Reports
Meta's AI-Assisted Layoff Process Allegedly Disproportionately Selected Employees on Protected Leave
- Incident 14712 Reports
Meta Internal AI Agent Reportedly Gave Advice That Allegedly Exposed Sensitive Data to Unauthorized Employees