Registro de citas para el Incidente 87

Description: UK passport photo checker shows bias against dark-skinned women.

Herramientas

Nuevo InformeNuevo InformeNueva RespuestaNueva RespuestaDescubrirDescubrirVer HistorialVer Historial
Presunto: un sistema de IA desarrollado e implementado por UK Home Office, perjudicó a dark-skinned people y dark-skinned women.

Estadísticas de incidentes

ID
87
Cantidad de informes
1
Fecha del Incidente
2020-10-07
Editores
Sean McGregor, Khoa Lam

Clasificaciones de la Taxonomía CSETv0

Detalles de la Taxonomía

Full Description

Women with darker skin are more than twice as likely to be told their photos fail UK passport rules when they submit them online when compared to lighter-skinned men, according to a BBC investigation. Elaine Owusu, a Black student, said she was wrongly told her mouth looked open each time she uploaded five different photos to the government website. This shows how "systemic racism" can spread. The facial recognition software was used by the Home Office of the British goverment to help users get their passports more quickly. Additionally, Cat Hallam, who describes her complexion as dark-skinned, told the BBC reporters that her photos have been judged to be poor quality which included "there are reflections on your face" and "your image and the background are difficult to tell apart."

Short Description

UK passport photo checker shows bias against dark-skinned women.

Severity

Negligible

Harm Distribution Basis

Race, Sex

Harm Type

Psychological harm, Harm to civil liberties

AI System Description

The facial recognition algorithm used by the Home Office of the UK Government to identify and check for applicant's passport photos

System Developer

The Home Office of the UK Government

Sector of Deployment

Administrative and support service activities

Relevant AI functions

Perception, Cognition

AI Techniques

Facial recognition

AI Applications

Facial recognition

Location

United Kingdom

Named Entities

Elaine Owusu, The Home Office, Cat Hallam, Alan Turing Institute

Technology Purveyor

The Home Office of the UK Government

Beginning Date

10/2020

Ending Date

10/2020

Near Miss

Unclear/unknown

Intent

Accident

Lives Lost

No

Data Inputs

Passport IDs

El verificador de fotos de pasaportes del Reino Unido muestra prejuicios contra las mujeres de piel oscura
bbc.co.uk · 2020

Las mujeres con piel más oscura tienen más del doble de probabilidades de que les digan que sus fotos no cumplen con las normas de pasaporte del Reino Unido cuando las envían en línea que los hombres con piel más clara, según una investigac…

Variantes

Una "Variante" es un incidente que comparte los mismos factores causales, produce daños similares e involucra los mismos sistemas inteligentes que un incidente de IA conocido. En lugar de indexar las variantes como incidentes completamente separados, enumeramos las variaciones de los incidentes bajo el primer incidente similar enviado a la base de datos. A diferencia de otros tipos de envío a la base de datos de incidentes, no se requiere que las variantes tengan informes como evidencia externa a la base de datos de incidentes. Obtenga más información del trabajo de investigación.