Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
発見する
投稿する
  • ようこそAIIDへ
  • インシデントを発見
  • 空間ビュー
  • テーブル表示
  • リスト表示
  • 組織
  • 分類法
  • インシデントレポートを投稿
  • 投稿ランキング
  • ブログ
  • AIニュースダイジェスト
  • リスクチェックリスト
  • おまかせ表示
  • サインアップ
閉じる
発見する
投稿する
  • ようこそAIIDへ
  • インシデントを発見
  • 空間ビュー
  • テーブル表示
  • リスト表示
  • 組織
  • 分類法
  • インシデントレポートを投稿
  • 投稿ランキング
  • ブログ
  • AIニュースダイジェスト
  • リスクチェックリスト
  • おまかせ表示
  • サインアップ
閉じる

インシデント 48: Passport checker Detects Asian man's Eyes as Closed

概要: New Zealand passport robot reader rejects the application of an applicant with Asian descent and says his eyes are closed.

ツール

新しいレポート新しいレポート新しいレスポンス新しいレスポンス発見する発見する履歴を表示履歴を表示

組織

すべての組織を表示
推定: New Zealandが開発し提供したAIシステムで、Asian Peopleに影響を与えた

インシデントのステータス

インシデントID
48
レポート数
22
インシデント発生日
2016-12-07
エディタ
Sean McGregor
Applied Taxonomies
CSETv0, CSETv1, GMF, MIT

CSETv0 分類法のクラス

分類法の詳細

Problem Nature

Indicates which, if any, of the following types of AI failure describe the incident: "Specification," i.e. the system's behavior did not align with the true intentions of its designer, operator, etc; "Robustness," i.e. the system operated unsafely because of features or changes in its environment, or in the inputs the system received; "Assurance," i.e. the system could not be adequately monitored or controlled during operation.
 

Unknown/unclear

Physical System

Where relevant, indicates whether the AI system(s) was embedded into or tightly associated with specific types of hardware.
 

Software only

Level of Autonomy

The degree to which the AI system(s) functions independently from human intervention. "High" means there is no human involved in the system action execution; "Medium" means the system generates a decision and a human oversees the resulting action; "low" means the system generates decision-support output and a human makes a decision and executes an action.
 

Medium

Nature of End User

"Expert" if users with special training or technical expertise were the ones meant to benefit from the AI system(s)’ operation; "Amateur" if the AI systems were primarily meant to benefit the general public or untrained users.
 

Amateur

Public Sector Deployment

"Yes" if the AI system(s) involved in the accident were being used by the public sector or for the administration of public goods (for example, public transportation). "No" if the system(s) were being used in the private sector or for commercial purposes (for example, a ride-sharing company), on the other.
 

No

Data Inputs

A brief description of the data that the AI system(s) used or were trained on.
 

ID photos

CSETv1 分類法のクラス

分類法の詳細

Incident Number

The number of the incident in the AI Incident Database.
 

48

Special Interest Intangible Harm

An assessment of whether a special interest intangible harm occurred. This assessment does not consider the context of the intangible harm, if an AI was involved, or if there is characterizable class or subgroup of harmed entities. It is also not assessing if an intangible harm occurred. It is only asking if a special interest intangible harm occurred.
 

yes

Date of Incident Year

The year in which the incident occurred. If there are multiple harms or occurrences of the incident, list the earliest. If a precise date is unavailable, but the available sources provide a basis for estimating the year, estimate. Otherwise, leave blank. Enter in the format of YYYY
 

2016

Date of Incident Month

The month in which the incident occurred. If there are multiple harms or occurrences of the incident, list the earliest. If a precise date is unavailable, but the available sources provide a basis for estimating the month, estimate. Otherwise, leave blank. Enter in the format of MM
 

12

Estimated Date

“Yes” if the data was estimated. “No” otherwise.
 

No

Multiple AI Interaction

“Yes” if two or more independently operating AI systems were involved. “No” otherwise.
 

no

MIT 分類法のクラス

Machine-Classified
分類法の詳細

Risk Subdomain

A further 23 subdomains create an accessible and understandable classification of hazards and harms associated with AI
 

1.3. Unequal performance across groups

Risk Domain

The Domain Taxonomy of AI Risks classifies risks into seven AI risk domains: (1) Discrimination & toxicity, (2) Privacy & security, (3) Misinformation, (4) Malicious actors & misuse, (5) Human-computer interaction, (6) Socioeconomic & environmental harms, and (7) AI system safety, failures & limitations.
 
  1. Discrimination and Toxicity

Entity

Which, if any, entity is presented as the main cause of the risk
 

AI

Timing

The stage in the AI lifecycle at which the risk is presented as occurring
 

Post-deployment

Intent

Whether the risk is presented as occurring as an expected or unexpected outcome from pursuing a goal
 

Unintentional

インシデントレポート

レポートタイムライン

+20
Passport blunder sees photo rejected for 'closed eyes'
New Zealand Passport Photo Checker Rejects Asian Guy’s Picture, Says His Eyes Are Closed‘Racist’ passport machine accuses Asian man of having eyes closed
Passport blunder sees photo rejected for 'closed eyes'

Passport blunder sees photo rejected for 'closed eyes'

newshub.co.nz

Robot passport checker rejects Asian man's photo for having his eyes closed

Robot passport checker rejects Asian man's photo for having his eyes closed

telegraph.co.uk

New Zealand passport robot tells applicant of Asian descent to open eyes

New Zealand passport robot tells applicant of Asian descent to open eyes

reuters.com

Asian man’s picture is rejected by New Zealand’s passport photo software because his “eyes were closed”

Asian man’s picture is rejected by New Zealand’s passport photo software because his “eyes were closed”

thesun.co.uk

New Zealand passport reader accuses Asian of having 'eyes closed'

New Zealand passport reader accuses Asian of having 'eyes closed'

theinquirer.net

NZ government accused of racism after passport renewal software ‘failed’ Asian man’s photo

NZ government accused of racism after passport renewal software ‘failed’ Asian man’s photo

news.com.au

Racist robot rejects Asian man's passport photo, claiming 'eyes are closed'

Racist robot rejects Asian man's passport photo, claiming 'eyes are closed'

nydailynews.com

Racist robot? New Zealand govt website tells Asian man to open eyes, rejects passport

Racist robot? New Zealand govt website tells Asian man to open eyes, rejects passport

indiatoday.in

Facial Recognition Tells An Asian Man His Eyes Are Closed

Facial Recognition Tells An Asian Man His Eyes Are Closed

digitaltrends.com

Facial recognition software rejects Asian man's passport photo because it thinks his eyes are closed

Facial recognition software rejects Asian man's passport photo because it thinks his eyes are closed

techspot.com

New Zealand Passport Website Rejects Asian Man's Photo For Having 'Closed' Eyes

New Zealand Passport Website Rejects Asian Man's Photo For Having 'Closed' Eyes

gizmodo.com.au

An algorithm rejected an Asian man's passport photo for having "closed eyes"

An algorithm rejected an Asian man's passport photo for having "closed eyes"

qz.com

New Zealander says passport photo rejection 'not racist'

New Zealander says passport photo rejection 'not racist'

bbc.com

Racist Passport Machine Rejects Photo Because "Subject's Eyes Are Closed"

Racist Passport Machine Rejects Photo Because "Subject's Eyes Are Closed"

elitereaders.com

Passport photo rejected by 'racist' facial recognition robot in New Zealand

Passport photo rejected by 'racist' facial recognition robot in New Zealand

dailystar.co.uk

Man sees humour in 'racist' facial recognition software

Man sees humour in 'racist' facial recognition software

nzherald.co.nz

'Racist' robot rejects Asian-face passport photo

'Racist' robot rejects Asian-face passport photo

rappler.com

Passport robot donned ‘racist’, tells applicant of Asian descent to open eyes

Passport robot donned ‘racist’, tells applicant of Asian descent to open eyes

tenplay.com.au

New Zealand passport robot thinks this Asian man's eyes are closed

New Zealand passport robot thinks this Asian man's eyes are closed

edition.cnn.com

'Racist' passport request riles New Zealand citizen of 10 years

'Racist' passport request riles New Zealand citizen of 10 years

stuff.co.nz

New Zealand Passport Photo Checker Rejects Asian Guy’s Picture, Says His Eyes Are Closed

New Zealand Passport Photo Checker Rejects Asian Guy’s Picture, Says His Eyes Are Closed

boredpanda.com

‘Racist’ passport machine accuses Asian man of having eyes closed

‘Racist’ passport machine accuses Asian man of having eyes closed

rt.com

Passport blunder sees photo rejected for 'closed eyes'
newshub.co.nz · 2016

(Richard Lee / Facebook)

The Department of Internal Affairs has found itself in a bit of a blunder after a young Asian man submitting a photo for his passport had it rejected due to 'closed eyes'.

Richard Lee is a Kiwi living in Australia a…

Robot passport checker rejects Asian man's photo for having his eyes closed
telegraph.co.uk · 2016

A man of Asian descent in New Zealand had his passport application rejected after the software that approves photos claimed his eyes were closed.

Richard Lee, a 22-year-old DJ and student, had his photo turned down by the Department of Inte…

New Zealand passport robot tells applicant of Asian descent to open eyes
reuters.com · 2016

A screenshot of New Zealand man Richard Lee's passport photo rejection notice, supplied to Reuters December 7, 2016. Richard Lee/Handout via REUTERS

SYDNEY (Reuters) - A New Zealand man of Asian descent had his passport photograph rejected …

Asian man’s picture is rejected by New Zealand’s passport photo software because his “eyes were closed”
thesun.co.uk · 2016

AN Asian man’s passport photo was rejected by the New Zealand government after its facial recognition software claimed his “eyes were closed”.

Richard Lee, who is originally from Taiwan, shared a screenshot of the awkward error message on F…

New Zealand passport reader accuses Asian of having 'eyes closed'
theinquirer.net · 2016

MOVE OVER Prince Philip, your racist remarks about Asian facial expressions are as nothing to the gesture of one Passport checking facial recognition robot.

Richard Lee, 22, was unable to renew his New Zealand passport after the software wh…

NZ government accused of racism after passport renewal software ‘failed’ Asian man’s photo
news.com.au · 2016

THE NEW Zealand government was accused of being racist after its passport renewal software failed to recognise an Asian man’s picture.

Richard Lee is from Taiwan but grew up in New Zealand. He has since moved to Australia and he went to ren…

Racist robot rejects Asian man's passport photo, claiming 'eyes are closed'
nydailynews.com · 2016

At the very least, Lee had a sense of humor about the situation. Using a Snapchat filter that ever so slightly exaggerated his features, he took another picture in which his eyes were more robot-friendly.

Racist robot? New Zealand govt website tells Asian man to open eyes, rejects passport
indiatoday.in · 2016

A New Zealand man of Asian descent had his passport photograph rejected when facial recognition software mistakenly registered his eyes as being closed.

Richard Lee's attempt to renew his passport was blocked after he submitted the picture …

Facial Recognition Tells An Asian Man His Eyes Are Closed
digitaltrends.com · 2016

Facial recognition is cool technology, but it’s not perfect. It’s used in many applications and services to provide an easier means of verification, such as Windows Hello using the tech to unlock Windows 10 so users aren’t required to manua…

Facial recognition software rejects Asian man's passport photo because it thinks his eyes are closed
techspot.com · 2016

Can software be racist? No, though humans can inadvertently design programs that appear racially insensitive, or, as was the case with Microsoft’s Tay chatbot, intentionally turn an AI into a raging hatemonger. Facial recognition systems oc…

New Zealand Passport Website Rejects Asian Man's Photo For Having 'Closed' Eyes
gizmodo.com.au · 2016

Anyone who's dealt with the complexities of passport photo requirements would probably jump at the chance to have their pics checked online, but automated systems can have their own complications, as a New Zealand man recently learned.

Scre…

An algorithm rejected an Asian man's passport photo for having "closed eyes"
qz.com · 2016

Another knock against the robots.

Earlier this week, an Asian New Zealander posted a screenshot to Facebook showing his passport photo being rejected for having closed eyes, even though they are visibly open. Twenty-two-year-old Richard Lee…

New Zealander says passport photo rejection 'not racist'
bbc.com · 2016

Image copyright Reuters/Richard Lee

A New Zealander of Asian descent has shrugged off the rejection of a passport application photo by software because of his eyes.

The system sent an error message after deciding Richard Lee's eyes were clo…

Racist Passport Machine Rejects Photo Because "Subject's Eyes Are Closed"
elitereaders.com · 2016

No one likes their passport photo. No matter how well you dress up or fix your hair or do your makeup, you’ll always look just a little bit awkward with a poker face, ears out, and facing the camera head-on.

Well one man looked nice enough …

Passport photo rejected by 'racist' facial recognition robot in New Zealand
dailystar.co.uk · 2016

DECLINED: The robots did not accept this photograph

Richard Lee, 22, sent a picture to a new online passport photo checker run by the government in New Zealand.

But the automated system told the furious DJ and engineering student his photo …

Man sees humour in 'racist' facial recognition software
nzherald.co.nz · 2016

A New Zealand man of Asian descent had his passport photo rejected by a government website when its facial recognition software registered his eyes as being closed.

Richard Lee was trying to renew his passport so he could return to Australi…

'Racist' robot rejects Asian-face passport photo
rappler.com · 2016

A computer-generated response said the photo of a New Zealander of Asian descent did not meet New Zealand's criteria because the 'eyes are closed'

Published 9:24 AM, December 08, 2016

WELLINGTON, New Zealand – A New Zealander of Asian desce…

Passport robot donned ‘racist’, tells applicant of Asian descent to open eyes
tenplay.com.au · 2016

A New Zealand man of Asian descent had his passport photo rejected when facial recognition software registered his eyes as being closed.

Richard Lee was trying to renew his passport so he could return to Australia from New Zealand after Chr…

New Zealand passport robot thinks this Asian man's eyes are closed
edition.cnn.com · 2016

(CNN) It's a common annoyance, you're filling out a form online and you get some error.

New Zealander Richard Lee was applying for a passport online when the system objected to the image he uploaded.

"The photo you want to upload does not m…

'Racist' passport request riles New Zealand citizen of 10 years
stuff.co.nz · 2017

A Palmerston North woman is alleging she was racially profiled by a health centre worker who said she didn't look like a Kiwi and asked for passport proof of her New Zealand citizenship.

But the health centre says the situation was a misund…

New Zealand Passport Photo Checker Rejects Asian Guy’s Picture, Says His Eyes Are Closed
boredpanda.com · 2017

Look at this picture of 22-year-old Richard Lee. Do his eyes look open to you? Of course they do. But that didn’t stop an automated online system from rejecting his passport renewal because, according to the facial recognition software, his…

‘Racist’ passport machine accuses Asian man of having eyes closed
rt.com · 2019

A New Zealand passport scanner made a ‘racist’ error when it rejected the photo of a man of Asian descent because it thought his eyes were closed.

Richard Lee had his passport renewal blocked when he submitted his photo to an online passpor…

バリアント

「バリアント」は既存のAIインシデントと同じ原因要素を共有し、同様な被害を引き起こし、同じ知的システムを含んだインシデントです。バリアントは完全に独立したインシデントとしてインデックスするのではなく、データベースに最初に投稿された同様なインシデントの元にインシデントのバリエーションとして一覧します。インシデントデータベースの他の投稿タイプとは違い、バリアントではインシデントデータベース以外の根拠のレポートは要求されません。詳細についてはこの研究論文を参照してください

よく似たインシデント

テキスト類似度による

Did our AI mess up? Flag the unrelated incidents

Images of Black People Labeled as Gorillas

When It Comes to Gorillas, Google Photos Remains Blind

Jun 2015 · 24 レポート
Defamation via AutoComplete

Algorithmic Defamation: The Case of the Shameless Autocomplete

Apr 2011 · 28 レポート
Picture of Woman on Side of Bus Shamed for Jaywalking

Chinese AI caught out by face in bus ad

Nov 2018 · 24 レポート
前のインシデント次のインシデント

よく似たインシデント

テキスト類似度による

Did our AI mess up? Flag the unrelated incidents

Images of Black People Labeled as Gorillas

When It Comes to Gorillas, Google Photos Remains Blind

Jun 2015 · 24 レポート
Defamation via AutoComplete

Algorithmic Defamation: The Case of the Shameless Autocomplete

Apr 2011 · 28 レポート
Picture of Woman on Side of Bus Shamed for Jaywalking

Chinese AI caught out by face in bus ad

Nov 2018 · 24 レポート

リサーチ

  • “AIインシデント”の定義
  • “AIインシデントレスポンス”の定義
  • データベースのロードマップ
  • 関連研究
  • 全データベースのダウンロード

プロジェクトとコミュニティ

  • AIIDについて
  • コンタクトとフォロー
  • アプリと要約
  • エディタのためのガイド

インシデント

  • 全インシデントの一覧
  • フラグの立ったインシデント
  • 登録待ち一覧
  • クラスごとの表示
  • 分類法

2024 - AI Incident Database

  • 利用規約
  • プライバシーポリシー
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • ecd56df