Description: Images purportedly generated by Gemini were reportedly circulated on X and Facebook in multiple languages claiming U.S. soldiers had been captured by the Iranian Revolutionary Guard Corps during the war in Iran. AFP said the images contained Gemini markers and other visual inconsistencies. Their circulation allegedly contributed to wartime misinformation and risked distorting public understanding of the conflict, including reported amplification by Jill Stein.
Editor Notes: See also Incident 1406: Purported AI-Generated War Footage Reportedly Circulated Widely Online During the Opening Phase of the War in Iran.
Entities
View all entitiesAlleged: Google developed an AI system deployed by Tayyaba Usmani , Information manipulation actors and Pro-Iranian information manipulation actors, which harmed Social media users , People seeking information about the war in Iran , National security and intelligence stakeholders , General public and Epistemic integrity.
Incident Stats
Risk Subdomain
A further 23 subdomains create an accessible and understandable classification of hazards and harms associated with AI
3.1. False or misleading information
Risk Domain
The Domain Taxonomy of AI Risks classifies risks into seven AI risk domains: (1) Discrimination & toxicity, (2) Privacy & security, (3) Misinformation, (4) Malicious actors & misuse, (5) Human-computer interaction, (6) Socioeconomic & environmental harms, and (7) AI system safety, failures & limitations.
- Misinformation
Entity
Which, if any, entity is presented as the main cause of the risk
AI
Timing
The stage in the AI lifecycle at which the risk is presented as occurring
Post-deployment
Intent
Whether the risk is presented as occurring as an expected or unexpected outcome from pursuing a goal
Unintentional
Incident Reports
Reports Timeline
Loading...
Despite US President Donald Trump dismissing the idea of sending ground troops to Iran amid the expanding war in the Middle East, images purporting to show American soldiers captured by the Iranian Revolutionary Guard have spread across soc…
Loading...
Fake photos of the war in Iran are flooding social media, with Elon Musk's X platform breaking its own rules by allowing users to create AI pictures of real warzones.
"Iran is totally winning", reads the caption on one fake image of a downe…
Variants
A "variant" is an AI incident similar to a known case—it has the same causes, harms, and AI system. Instead of listing it separately, we group it under the first reported incident. Unlike other incidents, variants do not need to have been reported outside the AIID. Learn more from the research paper.
Seen something similar?
