Description: Chinese law enforcement has targeted a rise in AI-driven crimes. The crimes include deepfake and voice synthesis used for fraud, identity theft, and unauthorized personality rights usage. In particular, "AI undressing" scams, fake relationships using synthesized voices, and game hacking software make up many of these cases. In response, authorities have prosecuted multiple cases and implemented stricter regulations to control AI misuse.
Editor Notes: Incident 834 represents an editorial challenge in that the reporting represents multiple discrete AI incidents that are also indicative of many other similar harm events, all collected in singular news reports. Names such as "Mouhe" and "Moumou" refer to practices in Chinese-language reporting that partially anonymize names. Here is a reconstruction of the incidents mentioned in this reporting: (1) In 2022, Wang Mouhe, a former gaming software developer, engineered and sold AI-driven cheating software that enabled automated aiming and shooting in games, which disrupted fair play and generated over ¥6.29 million in profits. On May 6, 2024, Wang received a three-year prison sentence, suspended for five years, marking China’s first recognized AI-related gaming cheat case. (2) On April 13, 2023, Zhu, a business owner, reported unauthorized access to her government app account, where her company’s electronic business license was downloaded. Investigation revealed that suspect Zeng Moumou had used Zhu’s personal information to create AI-generated face animations, allowing him to bypass the app’s facial recognition security and fraudulently access the account. In other words, this incident indicates the rise of other similar AI-enabled identity theft incidents. (3) In May 2023, a group began using AI to fabricate sensational viral videos, producing over 3,000 unverified clips to attract views and online engagement. (4) In June 2023, police in Shangyu, Zhejiang, identified a fabricated AI video depicting a fire at the Shangyu Industrial Park, with flames and explosions, which went viral online. Police later arrested Tang Mou, a network technology company employee, along with two accomplices, who were responsible for creating the composite video using AI. (5) On April 12, 2024, the Ministry of Public Security announced ten AI-related cybercrime cases, including four that involved AI-facilitated disinformation. (6) On April 23, 2024, Beijing Internet Court ruled on China’s first AI voice rights infringement case, ordering damages of ¥250,000 for unauthorized use of a plaintiff’s voice in an AI-based text-to-speech product. (7) On June 25, 2024, the Zhangjiagang Procuratorate in Jiangsu prosecuted a fraud ring that used AI to create fake images, posing as overseas Chinese students on dating platforms and extorting over ¥1 million from victims. (8) Law enforcement has responded through comprehensive measures: the Ministry of Public Security has expanded the “Clean Net” campaign to target AI-driven identity theft and disinformation schemes, collaborating with research institutions to enhance face recognition and liveness detection technology to defend against AI manipulation. (9) The incident date of July 4, 2024 is set because that is when the Legal Daily report published their comprehensive summary of AI-related criminal cases and the Chinese government’s crackdown on AI misuse. This report documents various cases of AI-driven fraud, disinformation, and identity theft, and it emphasizes law enforcement’s active measures escalating official responses to AI-enabled crimes. An earlier report from October 26, 2023 contains some information that makes up this incident ID as well.
Entités
Voir toutes les entitésPrésumé : un système d'IA développé par Unknown voice synthesis technology developers , Unknown game cheating technology developers and Unknown deepfake technology developers et mis en œuvre par Zeng Moumou , Wang Mouhe , Unknown deepfake creators , Tang Mou , scammers , Fraudsters , Bai Moumou , AI fraud rings in China and , endommagé Chinese general public and Chinese citizens.
Statistiques d'incidents
ID
834
Nombre de rapports
2
Date de l'incident
2024-07-04
Editeurs
Daniel Atherton
Rapports d'incidents
Chronologie du rapport
baijiahao.baidu.com · 2023
- Afficher le rapport d'origine à sa source
- Voir le rapport sur l'Archive d'Internet
translated-fr-人工智能(AI)技术飞速发展,一些不法分子利用其进行违法犯罪活动,给网络安全带来了严峻挑战。近期,公安机关破获多起涉人工智能案件。
今年6月,浙江绍兴上虞区警方发现有网民发布了关于上虞工业园区发生火灾的视频,浏览量在短时间内迅速上升。视频中,上虞区一工业园区内火势猛烈,整个园区被浓烟覆盖,现场不时传出爆炸声,场面惊心动魄。
民警核查发现,视频中的建筑、森林大火场景,并非该工业园真实场景,疑似源自其它视频。经分析,民警判断该视频是利用人工智能合成技术…
jsjc.gov.cn · 2024
- Afficher le rapport d'origine à sa source
- Voir le rapport sur l'Archive d'Internet
translated-fr-4月12日,公安部公布10起打击整治网络谣言违法犯罪典型案例,其中4起典型案例涉及使用人工智能(以下简称AI)技术编造虚假信息;4月23日,北京互联网法院一审开庭宣判AI生成声音人格权侵权案......
近年来,随着AI技术的快速发展,越来越多的人在工作生活中开始享受到该技术所带来的全新体验,但伴随而来的是,利用或滥用AI技术从事违法犯罪的活动(以下简称AI犯罪)日益增多。
对此,政法机关依法履职,持续深挖彻查AI犯罪,不断 扩大办案战果,努力提升打…
Variantes
Une "Variante" est un incident qui partage les mêmes facteurs de causalité, produit des dommages similaires et implique les mêmes systèmes intelligents qu'un incident d'IA connu. Plutôt que d'indexer les variantes comme des incidents entièrement distincts, nous listons les variations d'incidents sous le premier incident similaire soumis à la base de données. Contrairement aux autres types de soumission à la base de données des incidents, les variantes ne sont pas tenues d'avoir des rapports en preuve externes à la base de données des incidents. En savoir plus sur le document de recherche.
Incidents similaires
Did our AI mess up? Flag the unrelated incidents
Incidents similaires
Did our AI mess up? Flag the unrelated incidents