Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse

Incident 1057: "Jewish Baby Strollers" Provided Anti-Semitic Google Images, Allegedly Resulting from Hate Speech Campaign

Description: Google's Image search for "Jewish baby strollers" showed offensive, anti-Semitic results, allegedly a result of a coordinated hate-speech campaign involving malicious actors on 4chan.

Tools

New ReportNew ReportNew ResponseNew ResponseDiscoverDiscoverView HistoryView History

Entities

View all entities
Alleged: Google developed and deployed an AI system, which harmed Jewish people and Google Images users.

Incident Stats

Incident ID
1057
Report Count
2
Incident Date
2017-08-15
Editors
Sean McGregor, Khoa Lam

Incident Reports

Reports Timeline

Incident Occurrence+1
A Google search for ‘Jewish baby strollers’ yields anti-Semitic images. An extremist campaign may be to blame.
A Google search for ‘Jewish baby strollers’ yields anti-Semitic images. An extremist campaign may be to blame.

A Google search for ‘Jewish baby strollers’ yields anti-Semitic images. An extremist campaign may be to blame.

jta.org

Jewish Baby Stroller Image Algorithm

Jewish Baby Stroller Image Algorithm

timebulletin.com

A Google search for ‘Jewish baby strollers’ yields anti-Semitic images. An extremist campaign may be to blame.
jta.org · 2020

(JTA) — The Google results are shocking: Do an image search for “Jewish baby strollers” and you’ll see row upon row of portable ovens — an offensive allusion to the Holocaust.

Google says it’s looking into the search results and wants to im…

Jewish Baby Stroller Image Algorithm
timebulletin.com · 2020

The anti-Semitic movement has been on the rise coordinated by an online group named ‘raid’. They operate by manipulating the google image search engine results by attaching abusive images tagged with innocent keywords which in turn, shows t…

Variants

A "variant" is an incident that shares the same causative factors, produces similar harms, and involves the same intelligent systems as a known AI incident. Rather than index variants as entirely separate incidents, we list variations of incidents under the first similar incident submitted to the database. Unlike other submission types to the incident database, variants are not required to have reporting in evidence external to the Incident Database. Learn more from the research paper.

Similar Incidents

By textual similarity

Did our AI mess up? Flag the unrelated incidents

Microsoft’s Algorithm Allegedly Selected Photo of the Wrong Mixed-Race Person Featured in a News Story

Microsoft’s Algorithm Allegedly Selected Photo of the Wrong Mixed-Race Person Featured in a News Story

Jun 2020 · 12 reports
Biased Google Image Results

Biased Google Image Results

Mar 2016 · 18 reports
Chinese Tech Firms Allegedly Developed Facial Recognition to Identify People by Race, Targeting Uyghur Muslims

Chinese Tech Firms Allegedly Developed Facial Recognition to Identify People by Race, Targeting Uyghur Muslims

Jul 2018 · 2 reports
Previous IncidentNext Incident

Similar Incidents

By textual similarity

Did our AI mess up? Flag the unrelated incidents

Microsoft’s Algorithm Allegedly Selected Photo of the Wrong Mixed-Race Person Featured in a News Story

Microsoft’s Algorithm Allegedly Selected Photo of the Wrong Mixed-Race Person Featured in a News Story

Jun 2020 · 12 reports
Biased Google Image Results

Biased Google Image Results

Mar 2016 · 18 reports
Chinese Tech Firms Allegedly Developed Facial Recognition to Identify People by Race, Targeting Uyghur Muslims

Chinese Tech Firms Allegedly Developed Facial Recognition to Identify People by Race, Targeting Uyghur Muslims

Jul 2018 · 2 reports

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2024 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • 1420c8e