Synthetic image generation technology

Incidents involved as Developer

Incident 63231 Report
Significant Increase in Deepfake Nudes of Taylor Swift Circulating on Social Media

2024-01-24

AI-generated sexually explicit images of Taylor Swift circulated on X, garnering over 45 million views before removal. Originating from a Telegram group, these deepfakes challenge content moderation, as X's policies against synthetic media and nonconsensual nudity were violated.

Incident 14193 Report
Purported Deepfake Images of Gráinne Seoige Reportedly Circulated During Ireland's 2024 General Election Campaign

2025-02-16

A reported deepfake abuse campaign targeted Gráinne Seoige during her run in Ireland's 2024 general election campaign, when pornographic, purportedly AI-generated images of her were reportedly circulated online. Seoige later described the experience as humiliating and traumatic, and Gardaí said they were investigating the distribution of the material.

Incident 7672 Report
AI Image of Kamala Harris at DNC with Communist Flags Circulated by Trump

2024-08-18

Donald Trump shared an AI-generated image on social media that falsely depicted Kamala Harris speaking at a DNC event surrounded by communist imagery including the hammer and sickle of the Soviet Union. The image was intended to undermine Harris ahead of the Democratic National Convention and to suggest that her views are aligned with communism.

Incident 6131 Report
AI-Generated Images Available through Adobe Stock Misrepresent Real-World Events

2023-11-23

AI-generated images available through Adobe Stock, depicting realistic but fictional scenes of real-world events like wars and protests, have raised significant ethical concerns. These images blurred the lines between reality and fiction in journalistic contexts, prompting Adobe Stock to "crack down on AI-generated images that seem to depict real, newsworthy events and take new steps to prevent its images from being used in misleading ways."

Incident 59757 Report
Female Students at Westfield High School in New Jersey Reportedly Targeted with Deepfake Nudes

2023-10-20

In October 2023, alleged deepfake nude images of female students were created and shared at Westfield High School in New Jersey. One alleged implicated system in this incident is the Clothoff deepfake app. A victim, Francesca Mani, and her mother, Dorota, began advocating for stronger laws after the school’s response reportedly left perpetrators unaccountable. Since the incident, their advocacy has drawn national attention, leading to trips to Washington, D.C., and bipartisan backing for legislation targeting AI-generated nonconsensual content while calling attention to deficiencies in existing legal protections.

Incident 79927 Report
Aledo High School Student Allegedly Generates and Distributes Deepfake Nudes of Seven Female Classmates

2023-10-15

In October 2023, an unnamed male student at Aledo High School outside of Fort Worth, Texas allegedly generated and distributed deepfake nude pictures of classmate Elliston Berry and six other female students in her friend group via social media. Berry's mother, Anna McAdams, spoke with Senators Ted Cruz and Amy Klobuchar, who consequently drafted the Tools to Address Known Exploitation by Immobilizing Technological Deepfakes on Websites and Networks (or TAKE IT DOWN) Act.

Incident 54317 Report
Purported AI-Generated Image of Explosion Near Pentagon Reportedly Triggers Brief Market Dip and Public Confusion

2023-05-22

A Twitter/X account allegedly impersonating Bloomberg reportedly posted an image falsely showing an explosion near the Pentagon. Analysts reportedly described the image as likely AI-generated. The post reportedly spread through major accounts before officials confirmed no incident occurred. Markets reportedly dipped during the short period when the hoax circulated.

Incident 61011 Report
Purported Deepfake Technology Was Reportedly Used to Generate Naked Pictures of Underage Girls in Spanish Town

2023-09-17

In Spain, an AI app was used to digitally alter photos of young girls, making them appear naked. This manipulation sparked an investigation after these images were circulated in Almendralejo, a town in the Extremadura region, raising serious concerns about digital privacy violations and the potential spread of these images on pornographic sites.

Synthetic image generation technology

Incidents involved as Developer

Incident 63231 ReportSignificant Increase in Deepfake Nudes of Taylor Swift Circulating on Social Media

Incident 14193 ReportPurported Deepfake Images of Gráinne Seoige Reportedly Circulated During Ireland's 2024 General Election Campaign

Incident 7672 ReportAI Image of Kamala Harris at DNC with Communist Flags Circulated by Trump

Incident 6131 ReportAI-Generated Images Available through Adobe Stock Misrepresent Real-World Events

Incidents implicated systems

Incident 59757 ReportFemale Students at Westfield High School in New Jersey Reportedly Targeted with Deepfake Nudes

Incident 79927 ReportAledo High School Student Allegedly Generates and Distributes Deepfake Nudes of Seven Female Classmates

Incident 54317 ReportPurported AI-Generated Image of Explosion Near Pentagon Reportedly Triggers Brief Market Dip and Public Confusion

Incident 61011 ReportPurported Deepfake Technology Was Reportedly Used to Generate Naked Pictures of Underage Girls in Spanish Town

Related Entities Related EntitiesOther entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.

Related Entities

Stability AI

Incidents involved as both Developer and Deployer

Google

Incidents involved as both Developer and Deployer

Incidents involved as Developer

LAION

Incidents involved as Developer

Privacy

Incidents Harmed By

Lapine

Incidents Harmed By

Patients

Incidents Harmed By

Patients whose medical photos were included in LAION-5B

Incidents Harmed By

People whose private images were included in AI training datasets

Incidents Harmed By

Stable Diffusion

Incidents implicated systems

LAION-5B

Incidents implicated systems

Imagen

Incidents implicated systems

AI image training datasets

Incidents implicated systems

Web-scraped image-text datasets

Incidents implicated systems

Misinformation spreaders

Incidents involved as Deployer

Malicious actors

Incidents involved as Deployer

Information manipulation actors

Incidents involved as Deployer

Deepfake technology

Incidents involved as Developer

Incidents implicated systems