Incident 427: Cruise Taxis' Sudden Braking Allegedly Put People at Risk

Description: Cruise's autonomous taxis slowed suddenly, braked, and were hit from behind, allegedly becoming unexpected roadway obstacles and potentially putting passengers and other people at risk.

Tools

New ReportNew ReportNew ResponseNew ResponseDiscoverDiscoverView HistoryView History

Entities

View all entities
Alleged: Cruise developed and deployed an AI system, which harmed Cruise , traffic participants , emergency vehicles and Cruise passengers.

Incident Stats

Incident ID
427
Report Count
3
Incident Date
2022-03-15
Editors
Khoa Lam
Applied Taxonomies
MIT

MIT Taxonomy Classifications

Machine-Classified
Taxonomy Details

Risk Subdomain

7.3. Lack of capability or robustness

Risk Domain

  1. AI system safety, failures, and limitations

Entity

AI

Timing

Post-deployment

Intent

Unintentional

ODI Resume
static.nhtsa.gov · 2022

The National Highway Traffic Safety Administration (NHTSA) has received notices of incidents in which Automated Driving System (ADS) equipped vehicles operated by Cruise LLC (Cruise) may engage in inappropriately hard braking or become immo…

G.M. Unit’s Self-Driving Taxis Are Subject of U.S. Safety Investigation
nytimes.com · 2022

The main federal auto safety agency disclosed on Friday that it has begun a preliminary investigation into cars that a division of General Motors has been testing as driverless taxis in San Francisco.

The agency, the National Highway Traffi…

Do Cruise’s AVs brake-check other drivers? Feds are investigating
arstechnica.com · 2022

Update, 1:37 pm ET: Cruise reached out to Ars with the following statement: "Cruise’s safety record is publicly reported and includes having driven nearly 700,000 fully autonomous miles in an extremely complex urban environment with zero li…

Variants

A "variant" is an incident that shares the same causative factors, produces similar harms, and involves the same intelligent systems as a known AI incident. Rather than index variants as entirely separate incidents, we list variations of incidents under the first similar incident submitted to the database. Unlike other submission types to the incident database, variants are not required to have reporting in evidence external to the Incident Database. Learn more from the research paper.
Previous IncidentNext Incident