Incidente 665: Facial Recognition Misidentification at New World Westend in New Zealand

Descripción: A facial recognition system at New World Westend supermarket misidentified a Māori woman as a known offender during its trial. The woman was wrongfully accused of trespassing and experienced public embarrassment, raising concerns about racial bias and the technology's accuracy. The supermarket acknowledged its error and apologized.

Herramientas

Nuevo InformeNuevo InformeNueva RespuestaNueva RespuestaDescubrirDescubrirVer HistorialVer Historial

Entidades

Ver todas las entidades
Alleged: Foodstuffs developed an AI system deployed by Foodstuffs y New World Westend, which harmed Te Ani Solomon y Māori Community.

Estadísticas de incidentes

ID
665
Cantidad de informes
1
Fecha del Incidente
2024-04-02
Editores
Daniel Atherton
Applied Taxonomies
MIT

Clasificaciones de la Taxonomía MIT

Machine-Classified
Detalles de la Taxonomía

Risk Subdomain

1.1. Unfair discrimination and misrepresentation

Risk Domain

  1. Discrimination and Toxicity

Entity

Human

Timing

Post-deployment

Intent

Unintentional

Informes del Incidente

Cronología de Informes

Incident OccurrenceSupermarket facial recognition trial: Rotorua mother's "discrimination" ordeal
Supermarket facial recognition trial: Rotorua mother's "discrimination" ordeal
nzherald.co.nz · 2024

A Māori mum misidentified as a trespassed “thief” at a Rotorua supermarket trialling facial recognition technology says she felt “racially discriminated” against and embarrassed during the “horrible” birthday incident.

The supermarket, New …

Variantes

Una "Variante" es un incidente que comparte los mismos factores causales, produce daños similares e involucra los mismos sistemas inteligentes que un incidente de IA conocido. En lugar de indexar las variantes como incidentes completamente separados, enumeramos las variaciones de los incidentes bajo el primer incidente similar enviado a la base de datos. A diferencia de otros tipos de envío a la base de datos de incidentes, no se requiere que las variantes tengan informes como evidencia externa a la base de datos de incidentes. Obtenga más información del trabajo de investigación.
en revisión
Fecha del Incidente:
2024-04-17
Descripción de las circunstancias del incidente

It is not surprising that a supermarket trialling facial recognition technology mistakenly identified a Māori woman as a thief, Māori AI (artificial intelligence) and data experts say.

The woman was shopping at New World in Rotorua - one of 25 Foodstuffs’ North Island supermarkets trialling the technology - when she was approached by two staff members and asked to leave the store.

Salidas / Entradas

https://www.nzherald.co.nz/kahu/foodstuffs-facial-recognition-trial-maori-woman-mistaken-as-thief-not-surprising-experts-say/3DH6KYDHZ5GNVDUBHW5PARFGDM/

Incidentes Similares

Por similitud de texto

Did our AI mess up? Flag the unrelated incidents

Passport checker Detects Asian man's Eyes as Closed

Robot passport checker rejects Asian man's photo for having his eyes closed

· 22 informes
Facial Recognition Trial Performed Poorly at Notting Hill Carnival

Don’t Believe the Algorithm

· 4 informes
Skating Rink’s Facial Recognition Cameras Misidentified Black Teenager as Banned Troublemaker

Teen turned away from roller rink after AI wrongly identifies her as banned troublemaker

· 3 informes
Incidente AnteriorSiguiente Incidente