Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse

Report 1879

Associated Incidents

Incident 2823 Report
Facebook’s Algorithm Mistook an Advertisement of Onions as Sexual Suggestive Content

Loading...
Facebook's nudity-spotting AI mistook a photo of some onions for 'sexually suggestive' content
businessinsider.com · 2020

Facebook's AI struggles to tell the difference between sexual pictures of the human body and globular vegetables.

A garden center in Newfoundland, Canada on Monday received a notice from Facebook about an ad it had uploaded for Walla Walla onion seeds that contained a photo of some onions.

Facebook's notice said the ad broke its rules on "products with overtly sexual positioning," clarifying: "listings may not position products or services in a sexually suggestive manner."

Facebook on Wednesday told Canada's CBC News the ad had been reinstated after review. The mistake had been made by its AI moderation tech, which automatically takes down content it thinks contains nudity, it said.

"We use automated technology to keep nudity off our apps. But sometimes it doesn't know a walla walla onion from a, well, you know. We restored the ad and are sorry for the business' trouble," Meg Sinclair, Facebook Canada's head of communications told CBC.

She did not clarify what she meant by a "you know."

This is not the first time Facebook's automated systems have over-zealously removed content later reinstated by human moderators. In 2018 its systems took down a post containing excerpts from the Declaration of Independence after it flagged the post as containing hate speech.

Read the Source

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2024 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • e1b50cd