Description: In China, AI tools were reportedly used to fabricate and disseminate false reports of disasters, including a landslide in Yunnan, an earthquake in Sichuan, and a sudden death after a traffic incident. On May 27, 2024, a real 5.0-magnitude earthquake occurred in Muli County, Sichuan, with no casualties and limited property damage. However, a social media post later falsely claimed the epicenter was in Xide County and exaggerated the event's severity, adding fabricated images of extensive destruction. The deployers of these false reports have since received administrative penalties from Chinese authorities for their actions.
Editor Notes: Incident 835 presents multiple discrete AI-related incidents, each pointing to the wider application of AI tools to fabricate events and spread misinformation on social media throughout China, similar to Incident 834. Anonymous names like "Moumou" are used to preserve privacy in reporting. The following is a reconstruction of the timeline of events associated with this incident ID: (1) 1/23/2024, a fabricated landslide incident in Yunnan: Yang Moumou allegedly used AI tools to create and share a fake news article claiming that a landslide in Yunnan had resulted in eight deaths. That misinformation was posted on social media to attract views and engagement. Authorities identified the incident as AI-driven misinformation, and Yang was subsequently given an administrative penalty. (2) 5/27/2024, a real 5.0-magnitude earthquake occurred in Muli County, Sichuan. It resulted in minor property damage but no casualties. However, this actual event would later become the basis for an exaggerated AI-fabricated narrative. (3) 6/9/2024, a fabricated earthquake report in Xide County, Sichuan: Luo Moumou reportedly used AI to enhance and circulate a false report about the May 27 earthquake, falsely claiming the epicenter was in Xide County, Sichuan, with severe property damage and casualties. The fabricated images and videos spread quickly on social media, which led to confusion and alarm. Luo received an administrative penalty for disseminating false information. (4) Sometime in June 2024, a fabricated fatal traffic incident in Chengcheng County: Tian Mou used AI to create and post a story claiming that a middle-aged woman in Chengcheng County suffered a fatal heart attack after her electric scooter was impounded during a traffic stop. The narrative was designed to generate an emotional response for the purposes of driving engagement, but it misled the public. Tian admitted to fabricating the story using AI and was issued an administrative penalty.
Entities
View all entitiesAlleged: Unknown deepfake technology developer and Unknown AI developers developed an AI system deployed by Yang Moumou , Tian Mou and Lou Moumou, which harmed Yunnan general public , Xide County in Sichuan residents , Sichuan general public , Muli County in Sichuan residents , Chinese general public , Chinese citizens and Chengcheng County Shaanxi residents.
Incident Stats
Incident ID
835
Report Count
1
Incident Date
2024-08-06
Editors
Daniel Atherton
Incident Reports
Reports Timeline
baijiahao.baidu.com · 2024
- View the original report at its source
- View the report at the Internet Archive
近年来,以大数据、人工智能(AI)等为代表的信息技术日新月异。与此同时,利用AI工具合成技术编造谣言,甚至生成逼近真实的图片、音视频,颠覆了"有图就有真相"的常规认知,让人难辨真假。今天,网警带你了解AI工具造谣背后的真相!
【AI造谣的定义】
AI造谣指的是利用人工智能技术生成虚假信息,包括文字、图片、音视频等,以此来制造网络谣言。
【AI造谣典型案例】
**案例一:**利用AI软件编造
"山体滑坡致8人遇难"网络谣言
2024年1月23日,有网民在某平台发布文章…
Variants
A "variant" is an incident that shares the same causative factors, produces similar harms, and involves the same intelligent systems as a known AI incident. Rather than index variants as entirely separate incidents, we list variations of incidents under the first similar incident submitted to the database. Unlike other submission types to the incident database, variants are not required to have reporting in evidence external to the Incident Database. Learn more from the research paper.
Similar Incidents
Did our AI mess up? Flag the unrelated incidents
Similar Incidents
Did our AI mess up? Flag the unrelated incidents