Incident List

This is a simple numeric listing of all incidents and their reports within the database. If you would like to explore the contents of the reports, you should work through the Discover app.

Incident 1 CitationDiscover

Google’s YouTube Kids App Presents Inappropriate Content

Incident 2 CitationDiscover

Warehouse robot ruptures can of bear spray and injures workers

Incident 3 CitationDiscover

Crashes with Maneuvering Characteristics Augmentation System (MCAS)

Incident 4 CitationDiscover

Uber AV Killed Pedestrian in Arizona

Incident 5 CitationDiscover

Collection of Robotic Surgery Malfunctions

Incident 6 CitationDiscover


Incident 11 CitationDiscover

Northpointe Risk Models

Incident 15 CitationDiscover

Amazon Censors Gay Books

Incident 16 CitationDiscover

Images of Black People Labeled as Gorillas

Incident 17 CitationDiscover

Inappropriate Gmail Smart Reply Suggestions

Incident 19 CitationDiscover

Sexist and Racist Google Adsense Advertisements

Incident 20 CitationDiscover

A Collection of Tesla Autopilot-Involved Crashes

Incident 21 CitationDiscover

Tougher Turing Test Exposes Chatbots’ Stupidity

Incident 22 CitationDiscover

Waze Navigates Motorists into Wildfires

Incident 23 CitationDiscover

Las Vegas Self-Driving Bus Involved in Accident

Incident 24 CitationDiscover

Robot kills worker at German Volkswagen plant

Incident 26 CitationDiscover

Hackers Break Apple Face ID

Incident 27 CitationDiscover

Nuclear False Alarm

Incident 28 CitationDiscover

2010 Market Flash Crash

Incident 30 CitationDiscover

Poor Performance of Tesla Factory Robots

Incident 31 CitationDiscover

Driverless Train in Delhi Crashes due to Braking Failure

Incident 32 CitationDiscover

Identical Twins Can Open Apple FaceID Protected Devices

Incident 34 CitationDiscover

Amazon Alexa Responding to Environmental Inputs

Incident 35 CitationDiscover

Employee Automatically Terminated by Computer Program

Incident 36 CitationDiscover

Picture of Woman on Side of Bus Shamed for Jaywalking

Incident 37 CitationDiscover

Woman Down-ranked by Amazon Recruiting Tool

Incident 39 CitationDiscover

Deepfake Obama Introduction of Deepfakes

Incident 40 CitationDiscover

COMPAS Algorithm Performs Poorly in Crime Recidivism Prediction

Incident 41 CitationDiscover

All Image Captions Produced are Violent

Incident 42 CitationDiscover

Inefficiencies in the United States Resident Matching Program

Incident 44 CitationDiscover

Machine Personal Assistants Failed to Maintain Social Norms

Incident 45 CitationDiscover

Defamation via AutoComplete

Incident 48 CitationDiscover

Passport checker Detects Asian man's Eyes as Closed

Incident 50 CitationDiscover

The DAO Hack

Incident 51 CitationDiscover

Security Robot Rolls Over Child in Mall

Incident 52 CitationDiscover

Tesla Owner Killed in Crash While Watching Movie With AutoPilot Steering

Incident 53 CitationDiscover

Biased Google Image Results

Incident 54 CitationDiscover

Predictive Policing Biases of PredPol

Incident 55 CitationDiscover

Alexa Plays Pornography Instead of Kids Song

Incident 57 CitationDiscover

Centrelink's Debt Recovery System Treated Some Customers Unfairly

Incident 60 CitationDiscover

FaceApp Racial Filters

Incident 61 CitationDiscover

Overfit Kaggle Models Discouraged Data Science Competitors

Incident 63 CitationDiscover

Google Photo Merge Decapitates Subject

Incident 65 CitationDiscover

Reinforcement Learning Reward Functions in Video Games

Incident 66 CitationDiscover

Chinese Chatbots Question Communist Party

Incident 67 CitationDiscover

Sleeping Driver on Tesla AutoPilot

Incident 68 CitationDiscover

Security Robot Drowns Itself in a Fountain

Incident 71 CitationDiscover

Google admits its self driving car got it wrong: Bus crash was caused by software

Incident 72 CitationDiscover

Facebook translates 'good morning' into 'attack them', leading to arrest

Incident 75 CitationDiscover

Google Instant's Allegedly 'Anti-Semitic' Results Lead To Lawsuit In France

Incident 76 CitationDiscover

Live facial recognition is tracking kids suspected of being criminals

Incident 78 CitationDiscover

Meet the Secret Algorithm That's Keeping Students Out of College

Incident 81 CitationDiscover

Researchers find evidence of racial, gender, and socioeconomic bias in chest X-ray classifiers

Incident 82 CitationDiscover

#LekkiMassacre: Why Facebook labelled content from October 20 incident ‘false’

Incident 83 CitationDiscover

Spam filters are efficient and uncontroversial. Until you look at them.

Incident 84 CitationDiscover

Tiny Changes Let False Claims About COVID-19, Voting Evade Facebook Fact Checks

Incident 85 CitationDiscover

AI attempts to ease fear of robots, blurts out it can’t ‘avoid destroying humankind’

Incident 87 CitationDiscover

UK passport photo checker shows bias against dark-skinned women

Incident 88 CitationDiscover

Jewish Baby Stroller Image Algorithm

Incident 89 CitationDiscover

The Christchurch shooter and YouTube’s radicalization trap

Incident 95 CitationDiscover

Job Screening Service Halts Facial Analysis of Applicants

Incident 96 CitationDiscover

Houston Schools Must Face Teacher Evaluation Lawsuit

Incident 97 CitationDiscover

Tesla Autopilot Mistakes Red Letters on Flag for Red Traffic Lights

Incident 98 CitationDiscover

N.Y.P.D. Robot Dog’s Run Is Cut Short After Fierce Backlash

Incident 99 CitationDiscover

Major Universities Are Using Race as a “High Impact Predictor” of Student Success

Incident 100 CitationDiscover

How French welfare services are creating ‘robo-debt’

Incident 104 CitationDiscover

California's Algorithm Considered ZIP Codes in Vaccine Distribution, Allegedly Excluding Low-Income Neighborhoods and Communities of Color

Incident 105 CitationDiscover

Tesla Model 3 on Autopilot Crashed into a Ford Explorer Pickup, Killing a Fifteen-Year-Old in California

Incident 106 CitationDiscover

Korean Chatbot Luda Made Offensive Remarks towards Minority Groups

Incident 107 CitationDiscover

Chinese Tech Firms Allegedly Developed Facial Recognition to Identify People by Race, Targeting Uyghur Muslims

Incident 109 CitationDiscover

PimEyes's Facial Recognition AI Allegedly Lacked Safeguards to Prevent Itself from Being Abused

Incident 110 CitationDiscover

Arkansas's Opaque Algorithm to Allocate Health Care Excessively Cut Down Hours for Beneficiaries

Incident 113 CitationDiscover

Facebook's AI Put "Primates" Label on Video Featuring Black Men

Incident 114 CitationDiscover

Amazon's Rekognition Falsely Matched Members of Congress to Mugshots

Incident 116 CitationDiscover

Amazon's AI Cameras Incorrectly Penalized Delivery Drivers for Mistakes They Did Not Make

Incident 120 CitationDiscover

Philosophy AI Allegedly Used To Generate Mixture of Innocent and Harmful Reddit Posts

Incident 121 CitationDiscover

Autonomous Kargu-2 Drone Allegedly Remotely Used to Hunt down Libyan Soldiers

Incident 122 CitationDiscover

Facebook’s Tag Suggestions Tool Allegedly Stored Biometric Data without User Consent, Violating Illinois Biometric Information Privacy Act

Incident 123 CitationDiscover

Epic Systems’s Sepsis Prediction Algorithms Revealed to Have High Error Rates on Seriously Ill Patients

Incident 124 CitationDiscover

Algorithmic Health Risk Scores Reportedly Underestimated Black Patients’ Needs, Excluding Them from Extra Care Program

Incident 127 CitationDiscover

Microsoft’s Algorithm Allegedly Selected Photo of the Wrong Mixed-Race Person Featured in a News Story

Incident 128 CitationDiscover

Tesla Sedan on Autopilot Reportedly Drove Over Dividing Curb in Washington, Resulting in Minor Vehicle Damage

Incident 129 CitationDiscover

Facebook's Automated Tools Failed to Adequately Remove Hate Speech, Violence, and Incitement

Incident 131 CitationDiscover

Proctoring Algorithm in Online California Bar Exam Flagged an Unusually High Number of Alleged Cheaters

Incident 132 CitationDiscover

TikTok’s Content Moderation Allegedly Failed to Adequately Take down Videos Promoting Eating Disorders

Incident 133 CitationDiscover

Online Trolls Allegedly Abused TikTok’s Automated Content Reporting System to Discriminate against Marginalized Creators

Incident 134 CitationDiscover

Robot in Chinese Shopping Mall Fell off the Escalator, Knocking down Passengers

Incident 135 CitationDiscover

University of Texas at Austin’s Algorithm to Evaluate Graduate Applications, GRADE, Allegedly Exacerbated Existing Inequality for Marginalized Applicants, Prompting Tool Suspension

Incident 136 CitationDiscover

Brand Safety Tech Firms Falsely Claimed Use of AI, Blocking Ads Using Simple Keyword Lists

Incident 137 CitationDiscover

Israeli Tax Authority Employed Opaque Algorithm to Impose Fines, Reportedly Refusing to Provide an Explanation for Amount Calculation to a Farmer

Incident 139 CitationDiscover

Amazon’s Search and Recommendation Algorithms Found by Auditors to Have Boosted Products That Contained Vaccine Misinformation

Incident 140 CitationDiscover

ProctorU’s Identity Verification and Exam Monitoring Systems Provided Allegedly Discriminatory Experiences for BIPOC Students

Incident 142 CitationDiscover

Facebook’s Advertisement Moderation System Routinely Misidentified Adaptive Fashion Products as Medical Equipment and Blocked Their Sellers

Incident 143 CitationDiscover

Facebook’s and Twitter's Automated Content Moderation Reportedly Failed to Effectively Enforce Violation Rules for Small Language Groups

Incident 147 CitationDiscover

Hong Kong Bank Manager Swindled by Fraudsters Using Deepfaked Voice of Company Director

Incident 148 CitationDiscover

Web Accessibility Vendors Allegedly Falsely Claimed to Provide Compliance Using AI

Incident 150 CitationDiscover

Swedish Contraceptive App, Natural Cycles, Allegedly Failed to Correctly Map Menstrual Cycle

Incident 151 CitationDiscover

California Regulator Suspended's Driverless Testing Permit Following a Non-Fatal Collision

Incident 152 CitationDiscover

SoftBank's Humanoid Robot, Pepper, Reportedly Frequently Made Errors, Prompting Dismissal

Incident 154 CitationDiscover

Justice Department’s Recidivism Risk Algorithm PATTERN Allegedly Caused Persistent Disparities Along Racial Lines

Incident 155 CitationDiscover

Google Maps Allegedly Directed Sierra Nevada Travelers to Dangerous Roads amid Winter Storm

Incident 156 CitationDiscover

Amazon Reportedly Sold Products and Recommended Frequently Bought Together Items That Aid Suicide Attempts

Incident 157 CitationDiscover

Amazon’s Driver Monitoring System Cited by Delivery Van Driver for Allegedly Pushing Drivers to Prioritize Speed over Safety, Resulting in Crash

Incident 158 CitationDiscover

Facial Recognition in Remote Learning Software Reportedly Failed to Recognize a Black Student’s Face

Incident 161 CitationDiscover

Facebook's Ad Delivery Reportedly Excluded Audience along Racial and Gender Lines

Incident 162 CitationDiscover

ETS Used Allegedly Flawed Voice Recognition Evidence to Accuse and Assess Scale of Cheating, Causing Thousands to be Deported from the UK

Incident 164 CitationDiscover

Facebook "News Feed" Allegedly Boosted Misinformation and Violating Content Following Use of MSI Metric

Incident 165 CitationDiscover

Image Upscaling Algorithm PULSE Allegedly Produced Facial Images with Caucasian Features More Often

Incident 167 CitationDiscover

Researchers' Homosexual-Men Detection Model Denounced as a Threat to LGBTQ People’s Safety and Privacy

Incident 168 CitationDiscover

Collaborative Filtering Prone to Popularity Bias, Resulting in Overrepresentation of Popular Items in the Recommendation Outputs

Incident 169 CitationDiscover

Facebook Allegedly Failed to Police Anti-Rohingya Hate Speech Content That Contributed to Violence in Myanmar

Incident 170 CitationDiscover

Target Suggested Maternity-Related Advertisements to a Teenage Girl's Home, Allegedly Correctly Predicting Her Pregnancy via Algorithm

Incident 171 CitationDiscover

Traffic Camera Misread Text on Pedestrian's Shirt as License Plate, Causing UK Officials to Issue Fine to the Wrong Person

Incident 172 CitationDiscover

NarxCare’s Opaque Algorithm That Generates Patients’ Overdose Risk Scores Allegedly Lacked Validation and Used Data with High Risk of Gender and Racial Bias

Incident 173 CitationDiscover

AI Tools Failed to Sufficiently Predict COVID Patients, Some Potentially Harmful

Incident 176 CitationDiscover

Starship’s Autonomous Food Delivery Robot Allegedly Stranded at Railroad Crossing in Oregon, Run over by Freight Train

Incident 180 CitationDiscover

Algorithm Used by the Malaysian Judiciary Reportedly Recommended Unusually High Sentencing to a Drug Possession Case

Incident 181 CitationDiscover

BMW Sedan Made a Prohibited Left Turn, Colliding with a Cruise Autonomous Vehicle

Incident 191 CitationDiscover

Korean Internet Portal Giant Naver Manipulated Shopping and Video Search Algorithms to Favor In-House Services

Incident 193 CitationDiscover

Excessive Automated Monitoring Alerts Ignored by Staff, Resulting in Private Data Theft of Seventy Million Target Customers

Incident 194 CitationDiscover

Australian Telco’s Incident Management Bot Excessively Sent Technicians in the Field by Mistake, Allegedly Costing Millions

Incident 195 CitationDiscover

Predictive Policing Program by Florida Sheriff’s Office Allegedly Violated Residents’ Rights and Targeted Children of Vulnerable Groups

Incident 199 CitationDiscover

Ever AI Reportedly Deceived Customers about FRT Use in App

Incident 200 CitationDiscover

Fraudsters Used AI to Mimic Voice of a UK-Based Firm's CEO's Boss

Incident 201 CitationDiscover

Climate Action Group Posted Deepfake of Belgian Prime Minister Urging Climate Crisis Action

Incident 214 CitationDiscover

SN Technologies Reportedly Lied to a New York State School District about Its Facial and Weapon Detection Systems’ Performance

Incident 215 CitationDiscover

Facebook Content Moderators Demand Better Working Conditions Due to Allegedly Inadequate AI Content Moderation

Incident 219 CitationDiscover

Poachers Evaded AI Cameras and Killed Four Rhinos

Incident 222 CitationDiscover

Thoughts App Allegedly Created Toxic Tweets

Incident 223 CitationDiscover

Hive Box Facial-Recognition Locks Hacked by Fourth Graders Using Intended Recipient’s Facial Photo

Incident 224 CitationDiscover

WeChat Pay's Facial Recognition Security Evaded by Scammers Using Victims’ Social Media Content

Incident 225 CitationDiscover

IBM Watson for Oncology Criticized by Customers for Allegedly Unsafe and Inaccurate Cancer Treatment Recommendations

Incident 228 CitationDiscover

Apple Maps Allegedly Directed Ski Trip Couple Onto Unpaved Road in the Mountains

Incident 229 CitationDiscover

Content Using Bestiality Thumbnails Allegedly Evaded YouTube’s Thumbnail Monitoring System

Incident 230 CitationDiscover

Model 3 Tesla on Autopilot Crashed into a Truck in Florida, Killing Driver

Incident 233 CitationDiscover

Tumblr Automated Pornography-Detecting Algorithms Erroneously Flagged Inoffensive Images as Explicit

Incident 235 CitationDiscover

Chinese Insurer Ping An Employed Facial Recognition to Determine Customers’ Untrustworthiness, Which Critics Alleged to Likely Make Errors and Discriminate

Incident 236 CitationDiscover

AI-Generated Faces Used by Scammers to Pose as a Law Firm in Boston

Incident 238 CitationDiscover

Oregon’s Screening Tool for Child Abuse Cases Discontinued Following Concerns of Racial Bias

Incident 239 CitationDiscover

Algorithmic Teacher Evaluation Program Failed Student Outcome Goals and Allegedly Caused Harm Against Teachers

Incident 242 CitationDiscover

Manufacturing Robot Failure Caused Factory Worker's Death in India

Incident 243 CitationDiscover

Bots Allegedly Made up Roughly Half of Twitter Accounts in Discussions Surrounding COVID-19 Related Issues

Incident 244 CitationDiscover

Colorado Police’s Automated License Plate Reader (ALPR) Matched a Family’s Minivan’s Plate to That of a Stolen Vehicle Allegedly, Resulting in Detainment at Gunpoint

Incident 245 CitationDiscover

Unverified Misreading by Automated Plate Reader Led to Traffic Stop and Restraint of an Innocent Person at Gunpoint in California

Incident 248 CitationDiscover

Automated License Plate Camera Notified Police about a Previously Stolen Rental Car that was Returned, Causing an Innocent Person to be Detained at Gunpoint in California

Incident 249 CitationDiscover

Government Deployed Extreme Surveillance Technologies to Monitor and Target Muslim Minorities in Xinjiang

Incident 250 CitationDiscover

Dutch City Court Defended Home Value Generated by Black-Box Algorithm

Incident 251 CitationDiscover

Amazon Allegedly Tweaked Search Algorithm to Boost Its Own Products

Incident 252 CitationDiscover

Remotely Operated Taser-Armed Drones Proposed by Taser Manufacturer as Defense for School Shootings in the US

Incident 254 CitationDiscover

Google’s Face Grouping Feature Allegedly Collected and Analyzed Users’ Facial Structure without Consent or Notice, in Direct Violation of Illinois Biometric Information Privacy Act

Incident 255 CitationDiscover

Gunshot Detection Audio Picked up by ShotSpotter’s Algorithms Previously Admitted as Evidence of Conviction in a Murder Case in Chicago Now Dismissed due to Reports of Unreliability

Incident 256 CitationDiscover

DUI Arrest Case in Chicago Alleged in a Lawsuit to Have Based Solely on an Alert by ShotSpotter, Citing Concerns of Unreliability

Incident 257 CitationDiscover

Police Departments Reportedly Deployed Gunshot Detection Sensors Disproportionately in Black and Brown Neighborhoods

Incident 258 CitationDiscover

Australian Retailers Reported to Have Captured Face Prints of Their Customers without Consent, Potentially in Violation of Australian Privacy Act

Incident 259 CitationDiscover

YouTuber Built, Made Publicly Available, and Released Model Trained on Toxic 4chan Posts as Prank

Incident 260 CitationDiscover

US DHS’s Opaque Vetting Software Allegedly Relied on Poor-Quality Data and Discriminated against Immigrants

Incident 263 CitationDiscover

YouTube’s Content Recommendation Systems Implicated in One User’s Extreme Political Radicalization

Incident 264 CitationDiscover

AI-Based Vehicle Speed Estimation App Denounced by UK Drivers as Surveillance Technology

Incident 265 CitationDiscover

Black Uber Eats Driver Allegedly Subjected to Excessive Photo Checks and Dismissed via FRT Results

Incident 266 CitationDiscover

AI Partners Created by Chatbot App Replika Abused by Its Users

Incident 268 CitationDiscover

Permanent Removal of Social Media Content via Automated Tools Allegedly Prevented Investigative Efforts

Incident 270 CitationDiscover

Apple Tweaked App Store Ranking Algorithms, Allegedly Resulted in Demotion of Local Apps in China

Incident 273 CitationDiscover

FaceApp Predicted Different Genders for Similar User Photos with Slight Variations

Incident 274 CitationDiscover

Virginia Courts’ Algorithmic Recidivism Risk Assessment Failed to Lower Incarceration Rates

Incident 275 CitationDiscover

Facebook’s Content Moderation Algorithm Incorrectly Banned Users for a Photo of Aboriginal Men in Chains as Historical Evidence of Slavery

Incident 276 CitationDiscover

Local South Korean Government’s Use of CCTV Footage Analysis via Facial Recognition to Track COVID Cases Raised Concerns about Privacy, Retention, and Potential Misuse

Incident 277 CitationDiscover

Voices Created via Publicly Available AI-Audio Generation App Stolen and Resold as NFT without Acknowledgement

Incident 279 CitationDiscover

TikTok’s “For You” Algorithm Exposed Young Users to Pro-Eating Disorder Content

Incident 280 CitationDiscover

Coffee Meets Bagel’s Algorithm Reported by Users Disproportionately Showing Them Matches of Their Own Ethnicities Despite Selecting “No Preference”

Incident 283 CitationDiscover

Facebook’s Automated Content Moderation Tool Flagged a Post Containing Parts of the Declaration of Independence as Hate Speech by Mistake

Incident 285 CitationDiscover

Google Lens’s Camera-Based Translation Feature Provided an Offensive Mistranslation of a Book Title in Korean