Incident 453: Twitter's AI Moderation Tool Misidentified Rockets as Pornography

Description: Twitter's automated content moderation misidentified images of rocket launches as pornographic content, prompting incorrect account suspensions.

Tools

New ReportNew ReportNew ResponseNew ResponseDiscoverDiscoverView HistoryView History
Alleged: Twitter developed and deployed an AI system, which harmed Twitter Users.

Incident Stats

Incident ID
453
Report Count
1
Incident Date
2023-01-03
Editors
Khoa Lam
Twitter keeps confusing rockets for 'intimate' content because of the platform's reliance on machine learning tools, report says
businessinsider.com · 2023

A former Twitter employee said Elon Musk's company can mistake photos of rockets as intimate content because of the platform's reliance on machine learning tools, per Quartz.

The confusion resulted in several Twitter accounts posting about …

Variants

A "variant" is an incident that shares the same causative factors, produces similar harms, and involves the same intelligent systems as a known AI incident. Rather than index variants as entirely separate incidents, we list variations of incidents under the first similar incident submitted to the database. Unlike other submission types to the incident database, variants are not required to have reporting in evidence external to the Incident Database. Learn more from the research paper.