概要: In 2019, facial recognition technology misidentified Francisco Arteaga as a suspect in an armed robbery in New Jersey. The incident led to nearly four years of pretrial incarceration. Despite having an alibi, Arteaga was charged based on the flawed identification. The legal battle that followed resulted in a court ruling requiring police to reveal details about the algorithms used in facial recognition. The process exposed significant gaps in transparency and accountability.
Editor Notes: See Incident 815 for a broader overview of these specific kinds of harms. Reconstructing the timeline of events: (1) November 29, 2019: An armed robbery occurs at the Buenavista Multiservices store in West New York, New Jersey. Police submit surveillance footage for facial recognition analysis. (2) December 2019: The West New York Police Department sends surveillance footage to the NYPD's Real Time Crime Center, which identifies Francisco Arteaga as a possible match using facial recognition technology. (3) 2019-2022: Arteaga spends nearly four years in pretrial detention while fighting the charges, despite having an alibi. (4) May 13, 2022: A trial judge denies Arteaga’s motion for discovery on details of the facial recognition technology used in his case. (5) June 7, 2023: A New Jersey appellate court rules that Arteaga is entitled to information on the facial recognition technology used in his case, including the algorithm, error rates, and other relevant details.
Alleged: Clearview AI developed an AI system deployed by West New York PD , NYPD と Real Time Crime Center, which harmed Francisco Arteaga.
インシデントのステータス
Risk Subdomain
A further 23 subdomains create an accessible and understandable classification of hazards and harms associated with AI
7.3. Lack of capability or robustness
Risk Domain
The Domain Taxonomy of AI Risks classifies risks into seven AI risk domains: (1) Discrimination & toxicity, (2) Privacy & security, (3) Misinformation, (4) Malicious actors & misuse, (5) Human-computer interaction, (6) Socioeconomic & environmental harms, and (7) AI system safety, failures & limitations.
- AI system safety, failures, and limitations
Entity
Which, if any, entity is presented as the main cause of the risk
Human
Timing
The stage in the AI lifecycle at which the risk is presented as occurring
Post-deployment
Intent
Whether the risk is presented as occurring as an expected or unexpected outcome from pursuing a goal
Unintentional
インシデントレポート
レポートタイムライン
フランシスコ・アルテアガは昨年秋、法廷に出廷するために収監されていたが、裁判所の留置所の反対側から自分を睨んでいる大男に気づいた。
「この男の腕はこんな感じだろう？」とアルテアガは、空想上のポパイの上腕二頭筋を空中に描きながら言った。「首はない。頭は禿げて、つやがある。意地悪そうな顔で私を見ている。私は『オーマイゴッド！』と思った。彼は私の方へ歩いてきた。『君の名前はアルテアガか？』と尋ねた。私は『うん』と答えた。彼は大きな腕を広げて私を抱きしめた。『ありがとう、本当にありが…
バリアント
「バリアント」は既存のAIインシデントと同じ原因要素を共有し、同様な被害を引き起こし、同じ知的システムを含んだインシデントです。バリアントは完全に独立したインシデントとしてインデッ クスするのではなく、データベースに最初に投稿された同様なインシデントの元にインシデントのバリエーションとして一覧します。インシデントデータベースの他の投稿タイプとは違い、バリアントではインシデントデータベース以外の根拠のレポートは要求されません。詳細についてはこの研究論文を参照してください
よく似たインシデント
Did our AI mess up? Flag the unrelated incidents
よく似たインシデント
Did our AI mess up? Flag the unrelated incidents