Description: Chinese law enforcement has targeted a rise in AI-driven crimes. The crimes include deepfake and voice synthesis used for fraud, identity theft, and unauthorized personality rights usage. In particular, "AI undressing" scams, fake relationships using synthesized voices, and game hacking software make up many of these cases. In response, authorities have prosecuted multiple cases and implemented stricter regulations to control AI misuse.
Editor Notes: Incident 834 represents an editorial challenge in that the reporting represents multiple discrete AI incidents that are also indicative of many other similar harm events, all collected in singular news reports. Names such as "Mouhe" and "Moumou" refer to practices in Chinese-language reporting that partially anonymize names. Here is a reconstruction of the incidents mentioned in this reporting: (1) In 2022, Wang Mouhe, a former gaming software developer, engineered and sold AI-driven cheating software that enabled automated aiming and shooting in games, which disrupted fair play and generated over ¥6.29 million in profits. On May 6, 2024, Wang received a three-year prison sentence, suspended for five years, marking China’s first recognized AI-related gaming cheat case. (2) On April 13, 2023, Zhu, a business owner, reported unauthorized access to her government app account, where her company’s electronic business license was downloaded. Investigation revealed that suspect Zeng Moumou had used Zhu’s personal information to create AI-generated face animations, allowing him to bypass the app’s facial recognition security and fraudulently access the account. In other words, this incident indicates the rise of other similar AI-enabled identity theft incidents. (3) In May 2023, a group began using AI to fabricate sensational viral videos, producing over 3,000 unverified clips to attract views and online engagement. (4) In June 2023, police in Shangyu, Zhejiang, identified a fabricated AI video depicting a fire at the Shangyu Industrial Park, with flames and explosions, which went viral online. Police later arrested Tang Mou, a network technology company employee, along with two accomplices, who were responsible for creating the composite video using AI. (5) On April 12, 2024, the Ministry of Public Security announced ten AI-related cybercrime cases, including four that involved AI-facilitated disinformation. (6) On April 23, 2024, Beijing Internet Court ruled on China’s first AI voice rights infringement case, ordering damages of ¥250,000 for unauthorized use of a plaintiff’s voice in an AI-based text-to-speech product. (7) On June 25, 2024, the Zhangjiagang Procuratorate in Jiangsu prosecuted a fraud ring that used AI to create fake images, posing as overseas Chinese students on dating platforms and extorting over ¥1 million from victims. (8) Law enforcement has responded through comprehensive measures: the Ministry of Public Security has expanded the “Clean Net” campaign to target AI-driven identity theft and disinformation schemes, collaborating with research institutions to enhance face recognition and liveness detection technology to defend against AI manipulation. (9) The incident date of July 4, 2024 is set because that is when the Legal Daily report published their comprehensive summary of AI-related criminal cases and the Chinese government’s crackdown on AI misuse. This report documents various cases of AI-driven fraud, disinformation, and identity theft, and it emphasizes law enforcement’s active measures escalating official responses to AI-enabled crimes. An earlier report from October 26, 2023 contains some information that makes up this incident ID as well.
Alleged: Unknown voice synthesis technology developers , Unknown game cheating technology developers と Unknown deepfake technology developers developed an AI system deployed by Zeng Moumou , Wang Mouhe , Unknown deepfake creators , Tang Mou , scammers , Fraudsters , Bai Moumou , AI fraud rings in China と , which harmed Chinese general public と Chinese citizens.
インシデントのステータス
インシデントID
834
レポート数
2
インシデント発生日
2024-07-04
エディタ
Daniel Atherton
インシデントレポート
レポートタイムライン
baijiahao.baidu.com · 2023
- 情報源として元のレポートを表示
- インターネットアーカイブでレポートを表示
人工知能 (AI) テクノロジーは急速に発展しており、一部の犯罪者は人工知能 (AI) テクノロジーを利用して違法な犯罪活動を実行しており、ネットワーク セキュリティに深刻な課題をもたらしています。最近、公安機関は人工知能が関係する多くの事件を捜査している。
今年6月、浙江省紹興市上虞区の警察は、ネットユーザーが上虞工業団地の火災に関する動画を投稿したことを発見し、再生回数が短期間で急増した。ビデオでは、上虞区の工業団地で激しく火災が発生し、公園全体が濃い煙に覆われ、時折爆発…
jsjc.gov.cn · 2024
- 情報源として元のレポートを表示
- インターネットアーカイブでレポートを表示
公安省は4月12日、ネット上の噂や犯罪を取り締まる典型的な事例10件を発表したが、そのうち4件は人工知能(以下、AI)技術を利用して虚偽の情報を捏造するものだった。インターネット法廷はAI生成音声人格権侵害事件の第一審公判を開いた。
近年、AI技術の急速な発展に伴い、仕 事や生活においてAI技術による新たな体験を享受する人が増えていますが、それに伴ってAI技術が違法行為に利用・悪用されるケースも増えています。そして、犯罪行為(以下、AI犯罪)は日々増加しています。
この点におい…
バリアント
「バリアント」は既存のAIインシデントと同じ原因要素を共有し、同様な被害を引き起こし、同じ知的システムを含んだインシデントです。バリアントは完全に独立したインシデントとしてインデックスするのではなく、データベースに最初に投稿された同様なインシデントの元にインシデントのバリエーションとして一覧します。インシデントデータベースの他の投稿タイプとは違い、バリアントではインシデントデータベース以外の根拠のレポートは要求されません。詳細についてはこの研究論文を参照してください
よく似たインシデント
Did our AI mess up? Flag the unrelated incidents
よく似たインシデント
Did our AI mess up? Flag the unrelated incidents