Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Découvrir
Envoyer
  • Bienvenue sur AIID
  • Découvrir les incidents
  • Vue spatiale
  • Vue de tableau
  • Vue de liste
  • Entités
  • Taxonomies
  • Soumettre des rapports d'incident
  • Classement des reporters
  • Blog
  • Résumé de l’Actualité sur l’IA
  • Contrôle des risques
  • Incident au hasard
  • S'inscrire
Fermer
Découvrir
Envoyer
  • Bienvenue sur AIID
  • Découvrir les incidents
  • Vue spatiale
  • Vue de tableau
  • Vue de liste
  • Entités
  • Taxonomies
  • Soumettre des rapports d'incident
  • Classement des reporters
  • Blog
  • Résumé de l’Actualité sur l’IA
  • Contrôle des risques
  • Incident au hasard
  • S'inscrire
Fermer

Incident 691: Facewatch Reported to Have Wrongfully Flagged Home Bargains Customer as Shoplifter

Description: A facial-recognition software used by the British variety store Home Bargains is alleged to have misidentified "Sara" as a shoplifter, leading to staff searching her bag, escorting her from the premises, and banning her from the store. After, Facewatch is reported to have admitted its error to Sara. Facewatch is used by a number of different British stores.
Editor Notes: Incidents 691 and 692 are paired together in the reporting, but they are two separate, discrete harm events. I have created distinct incident IDs for each while replicating the reporting for each one.

Outils

Nouveau rapportNouveau rapportNouvelle RéponseNouvelle RéponseDécouvrirDécouvrirVoir l'historiqueVoir l'historique

Entités

Voir toutes les entités
Alleged: Facewatch developed an AI system deployed by Home Bargains, which harmed Sara , Home Bargains customers et General public.

Statistiques d'incidents

ID
691
Nombre de rapports
2
Date de l'incident
2024-05-25
Editeurs
Daniel Atherton
Applied Taxonomies
MIT

Classifications de taxonomie MIT

Machine-Classified
Détails de la taxonomie

Risk Subdomain

A further 23 subdomains create an accessible and understandable classification of hazards and harms associated with AI
 

1.1. Unfair discrimination and misrepresentation

Risk Domain

The Domain Taxonomy of AI Risks classifies risks into seven AI risk domains: (1) Discrimination & toxicity, (2) Privacy & security, (3) Misinformation, (4) Malicious actors & misuse, (5) Human-computer interaction, (6) Socioeconomic & environmental harms, and (7) AI system safety, failures & limitations.
 
  1. Discrimination and Toxicity

Entity

Which, if any, entity is presented as the main cause of the risk
 

AI

Timing

The stage in the AI lifecycle at which the risk is presented as occurring
 

Post-deployment

Intent

Whether the risk is presented as occurring as an expected or unexpected outcome from pursuing a goal
 

Unintentional

Rapports d'incidents

Chronologie du rapport

+1
'I was misidentified as shoplifter by facial recognition tech'
Innocent woman branded a shoplifter by facial recognition software
'I was misidentified as shoplifter by facial recognition tech'

'I was misidentified as shoplifter by facial recognition tech'

bbc.com

Innocent woman branded a shoplifter by facial recognition software

Innocent woman branded a shoplifter by facial recognition software

thetimes.co.uk

'I was misidentified as shoplifter by facial recognition tech'
bbc.com · 2024

Sara needed some chocolate - she had had one of those days - so wandered into a Home Bargains store.

"Within less than a minute, I'm approached by a store worker who comes up to me and says, 'You're a thief, you need to leave the store'."

S…

Innocent woman branded a shoplifter by facial recognition software
thetimes.co.uk · 2024

Shoppers have been warned that facial recognition software used by stores is wrongly identifying some innocent customers as thieves.

A woman said that an employee at Home Bargains, the variety store chain, accused her of being a shoplifter …

Variantes

Une "Variante" est un incident qui partage les mêmes facteurs de causalité, produit des dommages similaires et implique les mêmes systèmes intelligents qu'un incident d'IA connu. Plutôt que d'indexer les variantes comme des incidents entièrement distincts, nous listons les variations d'incidents sous le premier incident similaire soumis à la base de données. Contrairement aux autres types de soumission à la base de données des incidents, les variantes ne sont pas tenues d'avoir des rapports en preuve externes à la base de données des incidents. En savoir plus sur le document de recherche.

Incidents similaires

Selected by our editors
London Metropolitan Police's Facial Recognition Technology Reportedly Misidentified Shaun Thompson as Suspect Leading to Arrest

'I was misidentified as shoplifter by facial recognition tech'

Feb 2024 · 3 rapports
Par similarité textuelle

Did our AI mess up? Flag the unrelated incidents

ETS Used Allegedly Flawed Voice Recognition Evidence to Accuse and Assess Scale of Cheating, Causing Thousands to be Deported from the UK

The English test that ruined thousands of lives

Jan 2014 · 1 rapport
Skating Rink’s Facial Recognition Cameras Misidentified Black Teenager as Banned Troublemaker

Teen turned away from roller rink after AI wrongly identifies her as banned troublemaker

Jul 2021 · 3 rapports
Opaque Fraud Detection Algorithm by the UK’s Department of Work and Pensions Allegedly Discriminated against People with Disabilities

DWP urged to reveal algorithm that ‘targets’ disabled for benefit fraud

Oct 2019 · 6 rapports
Incident précédentProchain incident

Incidents similaires

Selected by our editors
London Metropolitan Police's Facial Recognition Technology Reportedly Misidentified Shaun Thompson as Suspect Leading to Arrest

'I was misidentified as shoplifter by facial recognition tech'

Feb 2024 · 3 rapports
Par similarité textuelle

Did our AI mess up? Flag the unrelated incidents

ETS Used Allegedly Flawed Voice Recognition Evidence to Accuse and Assess Scale of Cheating, Causing Thousands to be Deported from the UK

The English test that ruined thousands of lives

Jan 2014 · 1 rapport
Skating Rink’s Facial Recognition Cameras Misidentified Black Teenager as Banned Troublemaker

Teen turned away from roller rink after AI wrongly identifies her as banned troublemaker

Jul 2021 · 3 rapports
Opaque Fraud Detection Algorithm by the UK’s Department of Work and Pensions Allegedly Discriminated against People with Disabilities

DWP urged to reveal algorithm that ‘targets’ disabled for benefit fraud

Oct 2019 · 6 rapports

Recherche

  • Définition d'un « incident d'IA »
  • Définir une « réponse aux incidents d'IA »
  • Feuille de route de la base de données
  • Travaux connexes
  • Télécharger la base de données complète

Projet et communauté

  • À propos de
  • Contacter et suivre
  • Applications et résumés
  • Guide de l'éditeur

Incidents

  • Tous les incidents sous forme de liste
  • Incidents signalés
  • File d'attente de soumission
  • Affichage des classifications
  • Taxonomies

2024 - AI Incident Database

  • Conditions d'utilisation
  • Politique de confidentialité
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • ecd56df