Incident 654: Microsoft Copilot Designer Reportedly Generated Inappropriate AI Images

Description: A Microsoft engineer reported that Copilot Designer, an AI image generator, creates content depicting sex, violence, bias, and more. Despite raising concerns and suggesting improvements, the tool remains public, prompting a letter to the FTC.


New ReportNew ReportNew ResponseNew ResponseDiscoverDiscoverView HistoryView History
Alleged: Microsoft developed and deployed an AI system, which harmed General public and minors.

Incident Stats

Incident ID
Report Count
Incident Date
Daniel Atherton
Microsoft engineer sounds alarm on company's AI image generator in letter to FTC · 2024

A Microsoft employee is asking the US government to look into the safety of one of his employer's generative AI tools after learning it has the capacity to produce seemingly inappropriate images.

On Wednesday, Shane Jones, a principal softw…


A "variant" is an incident that shares the same causative factors, produces similar harms, and involves the same intelligent systems as a known AI incident. Rather than index variants as entirely separate incidents, we list variations of incidents under the first similar incident submitted to the database. Unlike other submission types to the incident database, variants are not required to have reporting in evidence external to the Incident Database. Learn more from the research paper.

Similar Incidents

By textual similarity

Did our AI mess up? Flag the unrelated incidents



· 28 reports