Incident 179: DALL-E 2 Reported for Gender and Racially Biased Outputs

Description: Developers of OpenAI's DALL-E 2 cited risks of the model, varying from misuse as disinformation and explicit content generation, to gender and racial bias.


New ReportNew ReportNew ResponseNew ResponseDiscoverDiscoverView HistoryView History
Alleged: OpenAI developed and deployed an AI system, which harmed underrepresented groups and Minority Groups.

Incident Stats

Incident ID
Report Count
Incident Date
Sean McGregor, Khoa Lam

GMF Taxonomy Classifications

Taxonomy Details

Known AI Goal

Visual Art Generation

Known AI Technology

Transformer, Distributional Learning

Known AI Technical Failure

Distributional Bias, Unsafe Exposure or Access, Misinformation Generation Hazard, Inappropriate Training Content

Potential AI Technical Failure

Unauthorized Data, Lack of Transparency

DALL·E 2 Preview - Risks and Limitations · 2022


Below, we summarize initial findings on potential risks associated with DALL·E 2, and mitigations aimed at addressing those risks as part of the ongoing Preview of this technology. We are sharing these findings in order to enable br…

A new AI draws delightful and not-so-delightful images · 2022

You may have seen some weird and whimsical pictures floating around the internet recently. There’s a Shiba Inu dog wearing a beret and black turtleneck. And a sea otter in the style of “Girl with a Pearl Earring” by the Dutch painter Vermee…

AI art tool DALL-E 2 adds 'black' or 'female' to some image prompts · 2022

Researchers experimenting with OpenAI's text-to-image tool, DALL-E 2, noticed that it seems to covertly be adding words such as "black" and "female" to image prompts, seemingly in an effort to diversify its output

Artificial intelligence fi…


A "variant" is an incident that shares the same causative factors, produces similar harms, and involves the same intelligent systems as a known AI incident. Rather than index variants as entirely separate incidents, we list variations of incidents under the first similar incident submitted to the database. Unlike other submission types to the incident database, variants are not required to have reporting in evidence external to the Incident Database. Learn more from the research paper.