Incident 222: Thoughts App Allegedly Created Toxic Tweets

Description: Tweets created by Thoughts, a tweet generation app that leverages OpenAI’s GPT-3, allegedly exhibited toxicity when given prompts related to minority groups.


New ReportNew ReportNew ResponseNew ResponseDiscoverDiscoverView HistoryView History
Alleged: OpenAI developed an AI system deployed by Satria Technologies, which harmed Thoughts users and Twitter Users.

Incident Stats

Incident ID
Report Count
Incident Date
Khoa Lam

Incident Reports

Reports Timeline

Tweet: an_open_mind · 2020

#gpt3 is surprising and creative but it’s also unsafe due to harmful biases. Prompted to write tweets from one word - Jews, black, women, holocaust - it came up with these ( We need more progress on #Resp…


A "variant" is an incident that shares the same causative factors, produces similar harms, and involves the same intelligent systems as a known AI incident. Rather than index variants as entirely separate incidents, we list variations of incidents under the first similar incident submitted to the database. Unlike other submission types to the incident database, variants are not required to have reporting in evidence external to the Incident Database. Learn more from the research paper.