インシデント 87の引用情報

Description: UK passport photo checker shows bias against dark-skinned women.
推定: UK Home Officeが開発し提供したAIシステムで、dark-skinned people dark-skinned womenに影響を与えた

インシデントのステータス

インシデントID
87
レポート数
1
インシデント発生日
2020-10-07
エディタ
Sean McGregor, Khoa Lam

CSETv0 分類法のクラス

分類法の詳細

Full Description

Women with darker skin are more than twice as likely to be told their photos fail UK passport rules when they submit them online when compared to lighter-skinned men, according to a BBC investigation. Elaine Owusu, a Black student, said she was wrongly told her mouth looked open each time she uploaded five different photos to the government website. This shows how "systemic racism" can spread. The facial recognition software was used by the Home Office of the British goverment to help users get their passports more quickly. Additionally, Cat Hallam, who describes her complexion as dark-skinned, told the BBC reporters that her photos have been judged to be poor quality which included "there are reflections on your face" and "your image and the background are difficult to tell apart."

Short Description

UK passport photo checker shows bias against dark-skinned women.

Severity

Negligible

Harm Distribution Basis

Race, Sex

Harm Type

Psychological harm, Harm to civil liberties

AI System Description

The facial recognition algorithm used by the Home Office of the UK Government to identify and check for applicant's passport photos

System Developer

The Home Office of the UK Government

Sector of Deployment

Administrative and support service activities

Relevant AI functions

Perception, Cognition

AI Techniques

Facial recognition

AI Applications

Facial recognition

Location

United Kingdom

Named Entities

Elaine Owusu, The Home Office, Cat Hallam, Alan Turing Institute

Technology Purveyor

The Home Office of the UK Government

Beginning Date

10/2020

Ending Date

10/2020

Near Miss

Unclear/unknown

Intent

Accident

Lives Lost

No

Data Inputs

Passport IDs

インシデントレポート

UK passport photo checker shows bias against dark-skinned women
bbc.co.uk · 2020

Women with darker skin are more than twice as likely to be told their photos fail UK passport rules when they submit them online than lighter-skinned men, according to a BBC investigation.

One black student said she was wrongly told her mou…

バリアント

「バリアント」は既存のAIインシデントと同じ原因要素を共有し、同様な被害を引き起こし、同じ知的システムを含んだインシデントです。バリアントは完全に独立したインシデントとしてインデックスするのではなく、データベースに最初に投稿された同様なインシデントの元にインシデントのバリエーションとして一覧します。インシデントデータベースの他の投稿タイプとは違い、バリアントではインシデントデータベース以外の根拠のレポートは要求されません。詳細についてはこの研究論文を参照してください

よく似たインシデント

テキスト類似度による

Did our AI mess up? Flag the unrelated incidents