AI Incident Roundup – December ‘22
Welcome to this month’s edition of The Monthly Roundup, a newsletter designed to give you a digestible recap on the latest incidents and reports of the AI Incident Database.
Estimated reading time: 5 minutes
🗞️ New Incidents
Emerging incidents that occurred last month:
- What happened? Facebook's algorithm was alleged in a complaint by Real Women in Trucking to have selectively shown job advertisements disproportionately against older and female workers in favor of younger men for blue-collar positions.
- What happened? Facebook's automated moderating system failed to flag and allowed ads containing explicit violent language against election workers to be published.
- What happened? Lawyers were barred from entry to Madison Square Garden after a facial recognition system matched them as employed by a law firm currently engaged in litigation with the venue.
- What happened? Southwest Airlines left passengers stranded for days throughout the flight network when Southwest crew scheduling software developed by General Electric repeatedly failed to recover from weather-induced flight cancellations.
📎 New Developments
Older incidents that have new reports or updates.
|Original incident||New report(s)|
|Incident #279: TikTok’s “For You” Algorithm Exposed Young Users to Pro-Eating Disorder Content|
|Incident #413 Thousands of Incorrect ChatGPT-Produced Answers Posted on Stack Overflow|
|Incident #418 Uber Locked Indian Drivers out of Accounts Allegedly Due to Facial Recognition Fails|
|Incident #420 Users Easily Bypassed Content Filters of OpenAI’s ChatGPT|
|Incident #421 Stable Diffusion Allegedly Used Artists’ Works without Permission for AI Training|
|Incident #423 Lensa AI’s Produced Unintended Sexually Explicit or Suggestive “Magic Avatars” for Women|
|Incident #424 Universities’ AI Proctoring Tools Allegedly Failed Canada’s Legal Threshold for Consent|
|Incident #425 State Farm Allegedly Discriminated against Black Customers in Claim Payout|
|Incident #427 Cruise Taxis’ Sudden Braking Allegedly Put People at Risk|
|Incident #431 Robbers Accessed Drugged Gay Men’s Bank Accounts Using Their Phones’ Facial Recognition|
|Incident #434 Sudden Braking by Tesla Autopilot Allegedly Caused Eight-Car Collision|
🗄 From the Archives
Every edition, we feature one or more historical incidents that we find thought-provoking.
Southwest Airlines’ mass flight cancellations highlighted how extreme weather can disrupt the operations of intelligent systems. The following examples from the AI Incident Database show that this is not the first time weather has interfered with intelligent systems.
In late December 2021, Google Maps directed drivers in the Sierra Nevada area to closed-off and even dangerous roads amid record-setting snowfall (Incident #155), while in February 2019 Apple Maps allegedly directed a couple on a ski trip in the mountains toward an unconventional route where the drivers found themselves stuck on an unpaved road in the snow (Incident #288). Self driving cars have also had difficulties navigating snow, as demonstrated in February 2016 when one of Volvo’s autonomous vehicles experienced sensor blindness raising concerns about future issues for self driving cars in snowy regions (Incident #70).
History has shown that rare and unpredictable circumstances challenge intelligent systems, and the weather will continue to surprise humans and break their computer systems.
👇 Diving Deeper
All new incidents added to the database in the last month, grouped by topic:
Explore clusters of similar incidents in Spatial Visualization
Check out Table View for a complete view of all incidents
Learn about alleged developers, deployers, and harmed parties in Entities Page
🦾 Support our Efforts
Still reading? Help us change the world for the better!
- Share this newsletter on LinkedIn, Twitter, and Facebook
- Submit incidents to the database
- Contribute to the database’s functionality
By Janet Schwartz & Khoa Lam