Incident 133: Online Trolls Allegedly Abused TikTok’s Automated Content Reporting System to Discriminate against Marginalized Creators
Description: TikTok's automated content reporting system was allegedly abused by online trolls to intentionally misreport content created by users of marginalized groups.
Entities
View all entitiesAlleged: TikTok developed and deployed an AI system, which harmed TikTok content creators of marginalized groups.
Incident Stats
Incident ID
133
Report Count
1
Incident Date
2020-12-15
Editors
Sean McGregor, Khoa Lam
GMF Taxonomy Classifications
Taxonomy DetailsKnown AI Goal
An AI Goal which is almost certainly pursued by the AI system referenced in the incident.
Automated Content Curation
Potential AI Technology
An AI Method / Technology which probably is a part of the implementation of the AI system referenced in the incident.
Visual Object Detection, Diverse Data
Potential AI Technical Failure
An AI Technical Failure which probably contributes to the AI system failure referenced in the incident.
Lack of Transparency, Misconfigured Threshold, Misconfigured Aggregation, Incomplete Data Attribute Capture
Incident Reports
Reports Timeline
losangelesblade.com · 2020
- View the original report at its source
- View the report at the Internet Archive
My name is Rosalynne (Rose) Montoya, I am a Latina, bisexual, transgender woman. I am a social media content creator and before Monday December 14th, 2020, I had grown my audience to 300K+ followers on my TikTok account. (@RosalynneMontoya)…
Variants
A "variant" is an incident that shares the same causative factors, produces similar harms, and involves the same intelligent systems as a known AI incident. Rather than index variants as entirely separate incidents, we list variations of incidents under the first similar incident submitted to the database. Unlike other submission types to the incident database, variants are not required to have reporting in evidence external to the Incident Database. Learn more from the research paper.
Similar Incidents
Did our AI mess up? Flag the unrelated incidents
Similar Incidents
Did our AI mess up? Flag the unrelated incidents