Incident List

This is a simple numeric listing of all incidents and their reports within the database. If you would like to explore the contents of the reports, you should work through the Discover app.

Incident 1 CitationDiscover

Google’s YouTube Kids App Presents Inappropriate Content

Incident 2 CitationDiscover

Warehouse robot ruptures can of bear spray and injures workers

Incident 3 CitationDiscover

Crashes with Maneuvering Characteristics Augmentation System (MCAS)

Incident 4 CitationDiscover

Uber AV Killed Pedestrian in Arizona

Incident 5 CitationDiscover

Collection of Robotic Surgery Malfunctions

Incident 6 CitationDiscover


Incident 11 CitationDiscover

Northpointe Risk Models

Incident 15 CitationDiscover

Amazon Censors Gay Books

Incident 16 CitationDiscover

Images of Black People Labeled as Gorillas

Incident 17 CitationDiscover

Inappropriate Gmail Smart Reply Suggestions

Incident 19 CitationDiscover

Sexist and Racist Google Adsense Advertisements

Incident 20 CitationDiscover

A Collection of Tesla Autopilot-Involved Crashes

Incident 21 CitationDiscover

Tougher Turing Test Exposes Chatbots’ Stupidity (migrated to Issue)

Incident 22 CitationDiscover

Waze Navigates Motorists into Wildfires

Incident 23 CitationDiscover

Las Vegas Self-Driving Bus Involved in Accident

Incident 24 CitationDiscover

Robot kills worker at German Volkswagen plant

Incident 26 CitationDiscover

Hackers Break Apple Face ID

Incident 27 CitationDiscover

Nuclear False Alarm

Incident 28 CitationDiscover

2010 Market Flash Crash

Incident 30 CitationDiscover

Poor Performance of Tesla Factory Robots

Incident 31 CitationDiscover

Driverless Train in Delhi Crashes due to Braking Failure

Incident 32 CitationDiscover

Identical Twins Can Open Apple FaceID Protected Devices

Incident 34 CitationDiscover

Amazon Alexa Responding to Environmental Inputs

Incident 35 CitationDiscover

Employee Automatically Terminated by Computer Program

Incident 36 CitationDiscover

Picture of Woman on Side of Bus Shamed for Jaywalking

Incident 37 CitationDiscover

Female Applicants Down-Ranked by Amazon Recruiting Tool

Incident 39 CitationDiscover

Deepfake Obama Introduction of Deepfakes

Incident 40 CitationDiscover

COMPAS Algorithm Performs Poorly in Crime Recidivism Prediction

Incident 41 CitationDiscover

All Image Captions Produced are Violent

Incident 44 CitationDiscover

Machine Personal Assistants Failed to Maintain Social Norms

Incident 45 CitationDiscover

Defamation via AutoComplete

Incident 48 CitationDiscover

Passport checker Detects Asian man's Eyes as Closed

Incident 50 CitationDiscover

The DAO Hack

Incident 51 CitationDiscover

Security Robot Rolls Over Child in Mall

Incident 52 CitationDiscover

Tesla on AutoPilot Killed Driver in Crash in Florida while Watching Movie

Incident 53 CitationDiscover

Biased Google Image Results

Incident 54 CitationDiscover

Predictive Policing Biases of PredPol

Incident 55 CitationDiscover

Alexa Plays Pornography Instead of Kids Song

Incident 57 CitationDiscover

Australian Automated Debt Assessment System Issued False Notices to Thousands

Incident 60 CitationDiscover

FaceApp Racial Filters

Incident 61 CitationDiscover

Overfit Kaggle Models Discouraged Data Science Competitors

Incident 62 CitationDiscover

Bad AI-Written Christmas Carols

Incident 63 CitationDiscover

Google Photo Merge Decapitates Subject

Incident 65 CitationDiscover

Reinforcement Learning Reward Functions in Video Games

Incident 66 CitationDiscover

Chinese Chatbots Question Communist Party

Incident 67 CitationDiscover

Sleeping Driver on Tesla AutoPilot

Incident 68 CitationDiscover

Security Robot Drowns Itself in a Fountain

Incident 71 CitationDiscover

Google admits its self driving car got it wrong: Bus crash was caused by software

Incident 72 CitationDiscover

Facebook translates 'good morning' into 'attack them', leading to arrest

Incident 75 CitationDiscover

Google Instant's Allegedly 'Anti-Semitic' Results Lead To Lawsuit In France

Incident 76 CitationDiscover

Live facial recognition is tracking kids suspected of being criminals

Incident 78 CitationDiscover

Meet the Secret Algorithm That's Keeping Students Out of College

Incident 81 CitationDiscover

Researchers find evidence of racial, gender, and socioeconomic bias in chest X-ray classifiers

Incident 82 CitationDiscover

#LekkiMassacre: Why Facebook labelled content from October 20 incident ‘false’

Incident 83 CitationDiscover

Spam filters are efficient and uncontroversial. Until you look at them.

Incident 84 CitationDiscover

Tiny Changes Let False Claims About COVID-19, Voting Evade Facebook Fact Checks

Incident 85 CitationDiscover

AI attempts to ease fear of robots, blurts out it can’t ‘avoid destroying humankind’

Incident 87 CitationDiscover

UK passport photo checker shows bias against dark-skinned women

Incident 88 CitationDiscover

"Jewish Baby Strollers" Provided Anti-Semitic Google Images, Allegedly Resulting from Hate Speech Campaign

Incident 89 CitationDiscover

The Christchurch shooter and YouTube’s radicalization trap

Incident 96 CitationDiscover

Houston Schools Must Face Teacher Evaluation Lawsuit

Incident 97 CitationDiscover

Tesla Autopilot Mistakes Red Letters on Flag for Red Traffic Lights

Incident 98 CitationDiscover

N.Y.P.D. Robot Dog’s Run Is Cut Short After Fierce Backlash

Incident 99 CitationDiscover

Major Universities Are Using Race as a “High Impact Predictor” of Student Success

Incident 100 CitationDiscover

How French welfare services are creating ‘robo-debt’

Incident 104 CitationDiscover

California's Algorithm Considered ZIP Codes in Vaccine Distribution, Allegedly Excluding Low-Income Neighborhoods and Communities of Color

Incident 105 CitationDiscover

Tesla Model 3 on Autopilot Crashed into a Ford Explorer Pickup, Killing a Fifteen-Year-Old in California

Incident 106 CitationDiscover

Korean Chatbot Luda Made Offensive Remarks towards Minority Groups

Incident 107 CitationDiscover

Chinese Tech Firms Allegedly Developed Facial Recognition to Identify People by Race, Targeting Uyghur Muslims

Incident 109 CitationDiscover

PimEyes's Facial Recognition AI Allegedly Lacked Safeguards to Prevent Itself from Being Abused

Incident 110 CitationDiscover

Arkansas's Opaque Algorithm to Allocate Health Care Excessively Cut Down Hours for Beneficiaries

Incident 112 CitationDiscover

Police Departments Reported ShotSpotter as Unreliable and Wasteful

Incident 113 CitationDiscover

Facebook's AI Put "Primates" Label on Video Featuring Black Men

Incident 114 CitationDiscover

Amazon's Rekognition Falsely Matched Members of Congress to Mugshots

Incident 116 CitationDiscover

Amazon's AI Cameras Incorrectly Penalized Delivery Drivers for Mistakes They Did Not Make

Incident 120 CitationDiscover

Philosophy AI Allegedly Used To Generate Mixture of Innocent and Harmful Reddit Posts

Incident 122 CitationDiscover

Facebook’s "Tag Suggestions" Allegedly Stored Biometric Data without User Consent

Incident 127 CitationDiscover

Microsoft’s Algorithm Allegedly Selected Photo of the Wrong Mixed-Race Person Featured in a News Story

Incident 128 CitationDiscover

Tesla Sedan on Autopilot Reportedly Drove Over Dividing Curb in Washington, Resulting in Minor Vehicle Damage

Incident 129 CitationDiscover

Facebook's Automated Tools Failed to Adequately Remove Hate Speech, Violence, and Incitement

Incident 131 CitationDiscover

Proctoring Algorithm in Online California Bar Exam Flagged an Unusually High Number of Alleged Cheaters

Incident 132 CitationDiscover

TikTok’s Content Moderation Allegedly Failed to Adequately Take down Videos Promoting Eating Disorders

Incident 133 CitationDiscover

Online Trolls Allegedly Abused TikTok’s Automated Content Reporting System to Discriminate against Marginalized Creators

Incident 134 CitationDiscover

Robot in Chinese Shopping Mall Fell off the Escalator, Knocking down Passengers

Incident 136 CitationDiscover

Brand Safety Tech Firms Falsely Claimed Use of AI, Blocking Ads Using Simple Keyword Lists

Incident 137 CitationDiscover

Israeli Tax Authority Employed Opaque Algorithm to Impose Fines, Reportedly Refusing to Provide an Explanation for Amount Calculation to a Farmer

Incident 139 CitationDiscover

Amazon’s Search and Recommendation Algorithms Found by Auditors to Have Boosted Products That Contained Vaccine Misinformation

Incident 140 CitationDiscover

ProctorU’s Identity Verification and Exam Monitoring Systems Provided Allegedly Discriminatory Experiences for BIPOC Students

Incident 142 CitationDiscover

Facebook’s Advertisement Moderation System Routinely Misidentified Adaptive Fashion Products as Medical Equipment and Blocked Their Sellers

Incident 143 CitationDiscover

Facebook’s and Twitter's Automated Content Moderation Reportedly Failed to Effectively Enforce Violation Rules for Small Language Groups

Incident 147 CitationDiscover

Hong Kong Bank Manager Swindled by Fraudsters Using Deepfaked Voice of Company Director

Incident 148 CitationDiscover

Web Accessibility Vendors Allegedly Falsely Claimed to Provide Compliance Using AI

Incident 150 CitationDiscover

Swedish Contraceptive App, Natural Cycles, Allegedly Failed to Correctly Map Menstrual Cycle

Incident 151 CitationDiscover

California Regulator Suspended's Driverless Testing Permit Following a Non-Fatal Collision

Incident 152 CitationDiscover

SoftBank's Humanoid Robot, Pepper, Reportedly Frequently Made Errors, Prompting Dismissal

Incident 154 CitationDiscover

Justice Department’s Recidivism Risk Algorithm PATTERN Allegedly Caused Persistent Disparities Along Racial Lines

Incident 155 CitationDiscover

Google Maps Allegedly Directed Sierra Nevada Travelers to Dangerous Roads amid Winter Storm

Incident 156 CitationDiscover

Amazon Reportedly Sold Products and Recommended Frequently Bought Together Items That Aid Suicide Attempts

Incident 157 CitationDiscover

Amazon's Monitoring System Allegedly Pushed Delivery Drivers to Prioritize Speed over Safety, Leading to Crash

Incident 158 CitationDiscover

Facial Recognition in Remote Learning Software Reportedly Failed to Recognize a Black Student’s Face

Incident 159 CitationDiscover

Tesla Autopilot’s Lane Recognition Allegedly Vulnerable to Adversarial Attacks

Incident 162 CitationDiscover

ETS Used Allegedly Flawed Voice Recognition Evidence to Accuse and Assess Scale of Cheating, Causing Thousands to be Deported from the UK

Incident 164 CitationDiscover

Facebook "News Feed" Allegedly Boosted Misinformation and Violating Content Following Use of MSI Metric

Incident 167 CitationDiscover

Researchers' Homosexual-Men Detection Model Denounced as a Threat to LGBTQ People’s Safety and Privacy

Incident 168 CitationDiscover

Collaborative Filtering Prone to Popularity Bias, Resulting in Overrepresentation of Popular Items in the Recommendation Outputs

Incident 169 CitationDiscover

Facebook Allegedly Failed to Police Anti-Rohingya Hate Speech Content That Contributed to Violence in Myanmar

Incident 170 CitationDiscover

Target Suggested Maternity-Related Advertisements to a Teenage Girl's Home, Allegedly Correctly Predicting Her Pregnancy via Algorithm

Incident 171 CitationDiscover

Traffic Camera Misread Text on Pedestrian's Shirt as License Plate, Causing UK Officials to Issue Fine to an Unrelated Person

Incident 172 CitationDiscover

NarxCare’s Risk Score Model Allegedly Lacked Validation and Trained on Data with High Risk of Bias

Incident 173 CitationDiscover

AI Tools Failed to Sufficiently Predict COVID Patients, Some Potentially Harmful

Incident 176 CitationDiscover

Starship’s Autonomous Food Delivery Robot Allegedly Stranded at Railroad Crossing in Oregon, Run over by Freight Train

Incident 180 CitationDiscover

Algorithm Used by the Malaysian Judiciary Reportedly Recommended Unusually High Sentencing to a Drug Possession Case

Incident 181 CitationDiscover

BMW Sedan Made a Prohibited Left Turn, Colliding with a Cruise Autonomous Vehicle

Incident 191 CitationDiscover

Korean Internet Portal Giant Naver Manipulated Shopping and Video Search Algorithms to Favor In-House Services

Incident 193 CitationDiscover

Excessive Automated Monitoring Alerts Ignored by Staff, Resulting in Private Data Theft of Seventy Million Target Customers

Incident 194 CitationDiscover

Australian Telco’s Incident Management Bot Excessively Sent Technicians in the Field by Mistake, Allegedly Costing Millions