Incident 48: Passport checker Detects Asian man's Eyes as Closed

Description: New Zealand passport robot reader rejects the application of an applicant with Asian descent and says his eyes are closed.

Tools

New ReportNew ReportNew ResponseNew ResponseDiscoverDiscover
Alleged: New Zealand developed and deployed an AI system, which harmed Asian People.

Incident Stats

Incident ID
48
Report Count
22
Incident Date
2016-12-07
Editors
Sean McGregor

CSET Taxonomy Classifications

Taxonomy Details

Full Description

Richard Lee, a New Zealander of Asian descent had submitted his ID photo to an online photo checker at New Zealand's Department of Internal Affairs and was told his eyes were closed. He was trying to renew his passport so he could return to Australia where he was studying aerospace engineering in Melbourne in December 2016. When asked about the incident, Lee said, "No hard feelings on my part, I've always had very small eyes and facial recognition technology is relatively new and unsophisticated."

Short Description

New Zealand passport robot reader rejects the application of an applicant with Asian descent and says his eyes are closed.

Severity

Negligible

Harm Distribution Basis

Race

Harm Type

Harm to civil liberties

AI System Description

The facial recognition software used by New Zealand's Department of Internal Affairs detects passport photos to make sure they meet all the government requirement.

Sector of Deployment

Administrative and support service activities

Relevant AI functions

Perception, Cognition, Action

AI Techniques

Facial recognition

AI Applications

Facial recognition

Location

New Zealand

Named Entities

New Zealand, Richard Lee, Department of Internal Affairs

Technology Purveyor

New Zealand's Department of Internal Affairs

Beginning Date

12/2016

Ending Date

12/2016

Near Miss

Unclear/unknown

Intent

Accident

Lives Lost

No

Data Inputs

ID photos

Variants

A "variant" is an incident that shares the same causative factors, produces similar harms, and involves the same intelligent systems as a known AI incident. Rather than index variants as entirely separate incidents, we list variations of incidents under the first similar incident submitted to the database. Unlike other submission types to the incident database, variants are not required to have reporting in evidence external to the Incident Database. Learn more from the research paper.

Similar Incidents

By textual similarity

Did our AI mess up? Flag the unrelated incidents