インシデント 88の引用情報

Description: Google's Image search for "Jewish baby strollers" showed offensive, anti-Semitic results, allegedly a result of a coordinated hate-speech campaign involving malicious actors on 4chan.
推定: Googleが開発し提供したAIシステムで、Jewish people Google Images usersに影響を与えた

インシデントのステータス

インシデントID
88
レポート数
2
インシデント発生日
2017-08-15
エディタ
Sean McGregor, Khoa Lam

CSETv0 分類法のクラス

分類法の詳細

Full Description

In October 2020, Google images showed anti-semitic images of a portable oven when a user searches "Jewish baby stroller" due to anti-semitic online groups tagging these anti-semitic images with the tag "Jewish baby stroller." Google claims this is a result of 'voids of information' or the algorithm being unable to decipher the image and relying on the images' tags.

Short Description

In October 2020, results for "Jewish baby stroller" on Google Images showed anti-semitic images as a result of organized online targeting by anti-Semitic online groups.

Severity

Minor

Harm Distribution Basis

Religion

Harm Type

Psychological harm

AI System Description

The Google image algorithm uses image recognition and appended text or tags to classify images.

System Developer

Google

Sector of Deployment

Information and communication

Relevant AI functions

Perception, Cognition, Action

AI Techniques

supervised learning, open source

AI Applications

image recognition, image classification, recommendation engine

Location

Global

Named Entities

Google Images, Google, raid

Technology Purveyor

Google, raid

Beginning Date

10/2020

Ending Date

10/2020

Near Miss

Harm caused

Intent

Deliberate or expected

Lives Lost

No

Data Inputs

images, tags, appended texts, user input

インシデントレポート

A Google search for ‘Jewish baby strollers’ yields anti-Semitic images. An extremist campaign may be to blame.
jta.org · 2020

(JTA) — The Google results are shocking: Do an image search for “Jewish baby strollers” and you’ll see row upon row of portable ovens — an offensive allusion to the Holocaust.

Google says it’s looking into the search results and wants to im…

Jewish Baby Stroller Image Algorithm
timebulletin.com · 2020

The anti-Semitic movement has been on the rise coordinated by an online group named ‘raid’. They operate by manipulating the google image search engine results by attaching abusive images tagged with innocent keywords which in turn, shows t…

バリアント

「バリアント」は既存のAIインシデントと同じ原因要素を共有し、同様な被害を引き起こし、同じ知的システムを含んだインシデントです。バリアントは完全に独立したインシデントとしてインデックスするのではなく、データベースに最初に投稿された同様なインシデントの元にインシデントのバリエーションとして一覧します。インシデントデータベースの他の投稿タイプとは違い、バリアントではインシデントデータベース以外の根拠のレポートは要求されません。詳細についてはこの研究論文を参照してください