Incident 453: Twitter's AI Moderation Tool Misidentified Rockets as Pornography
Description: Twitter's automated content moderation misidentified images of rocket launches as pornographic content, prompting incorrect account suspensions.
EntitiesView all entities
Alleged: Twitter developed and deployed an AI system, which harmed Twitter Users.
A former Twitter employee said Elon Musk's company can mistake photos of rockets as intimate content because of the platform's reliance on machine learning tools, per Quartz.
The confusion resulted in several Twitter accounts posting about …
A "variant" is an incident that shares the same causative factors, produces similar harms, and involves the same intelligent systems as a known AI incident. Rather than index variants as entirely separate incidents, we list variations of incidents under the first similar incident submitted to the database. Unlike other submission types to the incident database, variants are not required to have reporting in evidence external to the Incident Database. Learn more from the research paper.