Description: In Sichuan, AI tools were reportedly used to create and disseminate false reports across various cities, including fabricated stories of landslides, earthquakes, standoffs, accidents, and health-related incidents. These AI-driven rumors misled the public, caused alarm and confusion, and strained local authorities. The alleged perpetrators sought social media engagement and financial gain through clickbait content. The authorities in Sichuan ultimately levied administrative penalties against the perpetrators.
Editor Notes: Incident 836 presents an editorial challenge in that it is a composite of 10 discrete AI incidents that point to the possibility of other harm events (see Incidents 834 and 835 as well). "Moumou" and "Mou" refer to partially anonymized names in Chinese media. The following is a reconstruction of each incident outlined in this collective incident report; the majority (but not all) incidents were in Sichuan Province: (1) 11/20/2023 – Fabricated Chengdu Bus Accident: Chen Mou reportedly altered news of a bus crash in Chongqing to claim a similar incident occurred in Chengdu, alleging fatalities and severe impact. (2) 11/28/2023 – False Chengdu Construction Accident Report: Zhu Mou created a fake story about a construction accident in Chengdu’s Longquanyi District, falsely reporting multiple worker fatalities due to an electrical incident. (3) 12/27/2023 – Underground Pipeline Rupture Hoax in Xi’an: Wang Mou and Liu Mou allegedly spread a rumor about a broken underground heating pipeline in Xi’an, using AI to combine information with misleading images to attract attention. (4) 01/12/2024 – Fabricated Abandoned Infant Story in Guiyang: Zhou Mou reportedly used AI to create a story claiming a four-month-old infant was abandoned in Guiyang’s Huaxi District, falsely presenting a distressing social issue. (5) 01/23/2024 – Fabricated Landslide Fatalities in Yunnan: Yang Moumou allegedly spread a fake story claiming that a landslide in Yunnan resulted in eight deaths, using AI-generated information to amplify the incident’s impact (see Incident 835). (6) 04-05/2024 – False Banner and Ceremony Reports in Chengdu: Wang Mou allegedly created fake news about a banner encouraging second births, along with a fictional ceremony in Chengdu’s Pidu District, using AI to create convincing but false visuals. (7) 05/11/2024 – Heart Attack Incident in Xichang: Ji Moumou allegedly created a story about a man who reportedly died of a heart attack following a sex-related incident, spreading the rumor online to gain views. (8) 05/18/2024 – Bazhong Cash Transport Standoff: Shang Moumou allegedly fabricated a report about a standoff involving a cash transport vehicle in Bazhong, claiming a police-citizen confrontation for dramatic effect. (9) 06/09/2024 – Exaggerated Xide County Earthquake Report: Luo Moumou used AI tools to fabricate a story about an earthquake in Xide County, amplifying the damage and claiming casualties, despite the actual quake occurring in Muli County with minimal damage (see Incident 834). (10) 06/24/2024 – Elderly Abandonment Story in Chengdu: Zhang Mou reportedly created a false story of a 90-year-old man abandoned by his children, claiming he was found begging in Chengdu’s Xinjin District, using AI-generated visuals.
Entities
View all entitiesAlleged: Unknown deepfake technology developers and Unknown AI developers developed an AI system deployed by Zhu Mou , Zhou Moumou , Zhang Moumou , Yang Moumou , Wang Mou , Shang Moumou , Luo Moumou , Liu Mou , Ji Moumou and Chen Mou, which harmed Sichuan general public and Sichuan authorities.
Incident Reports
Reports Timeline
Variants
A "variant" is an incident that shares the same causative factors, produces similar harms, and involves the same intelligent systems as a known AI incident. Rather than index variants as entirely separate incidents, we list variations of incidents under the first similar incident submitted to the database. Unlike other submission types to the incident database, variants are not required to have reporting in evidence external to the Incident Database. Learn more from the research paper.
unreviewed
Incident Date:
2024-07-23
Similar Incidents
Did our AI mess up? Flag the unrelated incidents
Similar Incidents
Did our AI mess up? Flag the unrelated incidents