Incident 325: Offensive Instagram User Content Displayed as Facebook Ad

Description: An Instagram user’s image containing violent content was reportedly used as advertisement on Facebook allegedly via automated means.

Tools

New ReportNew ReportNew ResponseNew ResponseDiscoverDiscoverView HistoryView History
Alleged: Facebook developed and deployed an AI system, which harmed Olivia Solon and Olivia Solon's Facebook connections.

Incident Stats

Incident ID
325
Report Count
2
Incident Date
2017-09-21
Editors
Khoa Lam
Instagram uses 'I will rape you' post as Facebook ad in latest algorithm mishap
theguardian.com · 2017

Instagram used a user’s image which included the text “I will rape you before I kill you, you filthy whore!” to advertise its service on Facebook, the latest example of social media algorithms boosting offensive content.

Guardian reporter O…

Tweet: @oliviasolon
twitter.com · 2017

Instagram is using one of my most "engaging" posts to advertise its service to others on Facebook 😂

Oh and if you want to know the backstory to the abusive emails I receive this is a good place to start

Thanks Facebook for reminding me and…

Variants

A "variant" is an incident that shares the same causative factors, produces similar harms, and involves the same intelligent systems as a known AI incident. Rather than index variants as entirely separate incidents, we list variations of incidents under the first similar incident submitted to the database. Unlike other submission types to the incident database, variants are not required to have reporting in evidence external to the Incident Database. Learn more from the research paper.