Incident 665: Facial Recognition Misidentification at New World Westend in New Zealand

Description: A facial recognition system at New World Westend supermarket misidentified a Māori woman as a known offender during its trial. The woman was wrongfully accused of trespassing and experienced public embarrassment, raising concerns about racial bias and the technology's accuracy. The supermarket acknowledged its error and apologized.

Outils

Nouveau rapportNouveau rapportNouvelle RéponseNouvelle RéponseDécouvrirDécouvrirVoir l'historiqueVoir l'historique

Entités

Voir toutes les entités
Alleged: Foodstuffs developed an AI system deployed by Foodstuffs et New World Westend, which harmed Te Ani Solomon et Māori Community.

Statistiques d'incidents

ID
665
Nombre de rapports
1
Date de l'incident
2024-04-02
Editeurs
Daniel Atherton
Applied Taxonomies
MIT

Classifications de taxonomie MIT

Machine-Classified
Détails de la taxonomie

Risk Subdomain

1.1. Unfair discrimination and misrepresentation

Risk Domain

  1. Discrimination and Toxicity

Entity

Human

Timing

Post-deployment

Intent

Unintentional

Rapports d'incidents

Chronologie du rapport

Incident OccurrenceSupermarket facial recognition trial: Rotorua mother's "discrimination" ordeal
Supermarket facial recognition trial: Rotorua mother's "discrimination" ordeal
nzherald.co.nz · 2024

A Māori mum misidentified as a trespassed “thief” at a Rotorua supermarket trialling facial recognition technology says she felt “racially discriminated” against and embarrassed during the “horrible” birthday incident.

The supermarket, New …

Variantes

Une "Variante" est un incident qui partage les mêmes facteurs de causalité, produit des dommages similaires et implique les mêmes systèmes intelligents qu'un incident d'IA connu. Plutôt que d'indexer les variantes comme des incidents entièrement distincts, nous listons les variations d'incidents sous le premier incident similaire soumis à la base de données. Contrairement aux autres types de soumission à la base de données des incidents, les variantes ne sont pas tenues d'avoir des rapports en preuve externes à la base de données des incidents. En savoir plus sur le document de recherche.
non révisé
Date de l'incident:
2024-04-17
Description des circonstances de l'incident

It is not surprising that a supermarket trialling facial recognition technology mistakenly identified a Māori woman as a thief, Māori AI (artificial intelligence) and data experts say.

The woman was shopping at New World in Rotorua - one of 25 Foodstuffs’ North Island supermarkets trialling the technology - when she was approached by two staff members and asked to leave the store.

Entrées / Sorties

https://www.nzherald.co.nz/kahu/foodstuffs-facial-recognition-trial-maori-woman-mistaken-as-thief-not-surprising-experts-say/3DH6KYDHZ5GNVDUBHW5PARFGDM/

Incidents similaires

Par similarité textuelle

Did our AI mess up? Flag the unrelated incidents

Passport checker Detects Asian man's Eyes as Closed

Robot passport checker rejects Asian man's photo for having his eyes closed

· 22 rapports
Facial Recognition Trial Performed Poorly at Notting Hill Carnival

Don’t Believe the Algorithm

· 4 rapports
Skating Rink’s Facial Recognition Cameras Misidentified Black Teenager as Banned Troublemaker

Teen turned away from roller rink after AI wrongly identifies her as banned troublemaker

· 3 rapports
Incident précédentProchain incident