Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Descubrir
Enviar
  • Bienvenido a la AIID
  • Descubrir Incidentes
  • Vista espacial
  • Vista Tabular
  • Vista de lista
  • Entidades
  • Taxonomías
  • Enviar Informes de Incidentes
  • Ranking de Reportadores
  • Blog
  • Resumen de noticias de IA
  • Control de Riesgos
  • Incidente aleatorio
  • Registrarse
Colapsar
Descubrir
Enviar
  • Bienvenido a la AIID
  • Descubrir Incidentes
  • Vista espacial
  • Vista Tabular
  • Vista de lista
  • Entidades
  • Taxonomías
  • Enviar Informes de Incidentes
  • Ranking de Reportadores
  • Blog
  • Resumen de noticias de IA
  • Control de Riesgos
  • Incidente aleatorio
  • Registrarse
Colapsar

Incidente 834: China Targets AI-Driven Fraud and Deepfake Scandals with New Crackdowns

Descripción: Chinese law enforcement has targeted a rise in AI-driven crimes. The crimes include deepfake and voice synthesis used for fraud, identity theft, and unauthorized personality rights usage. In particular, "AI undressing" scams, fake relationships using synthesized voices, and game hacking software make up many of these cases. In response, authorities have prosecuted multiple cases and implemented stricter regulations to control AI misuse.
Editor Notes: Incident 834 represents an editorial challenge in that the reporting represents multiple discrete AI incidents that are also indicative of many other similar harm events, all collected in singular news reports. Names such as "Mouhe" and "Moumou" refer to practices in Chinese-language reporting that partially anonymize names. Here is a reconstruction of the incidents mentioned in this reporting: (1) In 2022, Wang Mouhe, a former gaming software developer, engineered and sold AI-driven cheating software that enabled automated aiming and shooting in games, which disrupted fair play and generated over ¥6.29 million in profits. On May 6, 2024, Wang received a three-year prison sentence, suspended for five years, marking China’s first recognized AI-related gaming cheat case. (2) On April 13, 2023, Zhu, a business owner, reported unauthorized access to her government app account, where her company’s electronic business license was downloaded. Investigation revealed that suspect Zeng Moumou had used Zhu’s personal information to create AI-generated face animations, allowing him to bypass the app’s facial recognition security and fraudulently access the account. In other words, this incident indicates the rise of other similar AI-enabled identity theft incidents. (3) In May 2023, a group began using AI to fabricate sensational viral videos, producing over 3,000 unverified clips to attract views and online engagement. (4) In June 2023, police in Shangyu, Zhejiang, identified a fabricated AI video depicting a fire at the Shangyu Industrial Park, with flames and explosions, which went viral online. Police later arrested Tang Mou, a network technology company employee, along with two accomplices, who were responsible for creating the composite video using AI. (5) On April 12, 2024, the Ministry of Public Security announced ten AI-related cybercrime cases, including four that involved AI-facilitated disinformation. (6) On April 23, 2024, Beijing Internet Court ruled on China’s first AI voice rights infringement case, ordering damages of ¥250,000 for unauthorized use of a plaintiff’s voice in an AI-based text-to-speech product. (7) On June 25, 2024, the Zhangjiagang Procuratorate in Jiangsu prosecuted a fraud ring that used AI to create fake images, posing as overseas Chinese students on dating platforms and extorting over ¥1 million from victims. (8) Law enforcement has responded through comprehensive measures: the Ministry of Public Security has expanded the “Clean Net” campaign to target AI-driven identity theft and disinformation schemes, collaborating with research institutions to enhance face recognition and liveness detection technology to defend against AI manipulation. (9) The incident date of July 4, 2024 is set because that is when the Legal Daily report published their comprehensive summary of AI-related criminal cases and the Chinese government’s crackdown on AI misuse. This report documents various cases of AI-driven fraud, disinformation, and identity theft, and it emphasizes law enforcement’s active measures escalating official responses to AI-enabled crimes. An earlier report from October 26, 2023 contains some information that makes up this incident ID as well.

Herramientas

Nuevo InformeNuevo InformeNueva RespuestaNueva RespuestaDescubrirDescubrirVer HistorialVer Historial

Entidades

Ver todas las entidades
Alleged: Unknown voice synthesis technology developers , Unknown game cheating technology developers y Unknown deepfake technology developers developed an AI system deployed by Zeng Moumou , Wang Mouhe , Unknown deepfake creators , Tang Mou , scammers , Fraudsters , Bai Moumou , AI fraud rings in China y , which harmed Chinese general public y Chinese citizens.

Estadísticas de incidentes

ID
834
Cantidad de informes
2
Fecha del Incidente
2024-07-04
Editores
Daniel Atherton
Applied Taxonomies
MIT

Clasificaciones de la Taxonomía MIT

Machine-Classified
Detalles de la Taxonomía

Risk Subdomain

A further 23 subdomains create an accessible and understandable classification of hazards and harms associated with AI
 

4.3. Fraud, scams, and targeted manipulation

Risk Domain

The Domain Taxonomy of AI Risks classifies risks into seven AI risk domains: (1) Discrimination & toxicity, (2) Privacy & security, (3) Misinformation, (4) Malicious actors & misuse, (5) Human-computer interaction, (6) Socioeconomic & environmental harms, and (7) AI system safety, failures & limitations.
 
  1. Malicious Actors & Misuse

Entity

Which, if any, entity is presented as the main cause of the risk
 

Human

Timing

The stage in the AI lifecycle at which the risk is presented as occurring
 

Post-deployment

Intent

Whether the risk is presented as occurring as an expected or unexpected outcome from pursuing a goal
 

Intentional

Informes del Incidente

Cronología de Informes

Tenga cuidado con el uso de tecnología de inteligencia artificial para cometer nuevos delitos+1
Las instituciones jurídicas toman medidas enérgicas contra los delitos relacionados con la IA para defender el Estado de derecho en la aplicación de la tecnología de IA
Tenga cuidado con el uso de tecnología de inteligencia artificial para cometer nuevos delitos

Tenga cuidado con el uso de tecnología de inteligencia artificial para cometer nuevos delitos

baijiahao.baidu.com

Las instituciones jurídicas toman medidas enérgicas contra los delitos relacionados con la IA para defender el Estado de derecho en la aplicación de la tecnología de IA

Las instituciones jurídicas toman medidas enérgicas contra los delitos relacionados con la IA para defender el Estado de derecho en la aplicación de la tecnología de IA

jsjc.gov.cn

Tenga cuidado con el uso de tecnología de inteligencia artificial para cometer nuevos delitos
baijiahao.baidu.com · 2023
Traducido por IA

La tecnología de inteligencia artificial (IA) se está desarrollando rápidamente y algunos delincuentes la utilizan para llevar a cabo actividades ilegales y delictivas, lo que plantea graves desafíos a la seguridad de la red. Recientemente,…

Las instituciones jurídicas toman medidas enérgicas contra los delitos relacionados con la IA para defender el Estado de derecho en la aplicación de la tecnología de IA
jsjc.gov.cn · 2024
Traducido por IA

El 12 de abril, el Ministerio de Seguridad Pública anunció 10 casos típicos de represión de rumores y delitos en línea, cuatro de los cuales involucraron el uso de tecnología de inteligencia artificial (en lo sucesivo, IA) para fabricar inf…

Variantes

Una "Variante" es un incidente que comparte los mismos factores causales, produce daños similares e involucra los mismos sistemas inteligentes que un incidente de IA conocido. En lugar de indexar las variantes como incidentes completamente separados, enumeramos las variaciones de los incidentes bajo el primer incidente similar enviado a la base de datos. A diferencia de otros tipos de envío a la base de datos de incidentes, no se requiere que las variantes tengan informes como evidencia externa a la base de datos de incidentes. Obtenga más información del trabajo de investigación.

Incidentes Similares

Por similitud de texto

Did our AI mess up? Flag the unrelated incidents

Robot in Chinese Shopping Mall Fell off the Escalator, Knocking down Passengers

Shopping mall robot fell off the escalator and knocked down passengers

Dec 2020 · 2 informes
Student-Developed Facial Recognition App Raised Ethical Concerns

AI Incident Database Incidents Converted to Issues

Oct 2021 · 1 informe
YouTube’s Recommendation Algorithm Allegedly Promoted Climate Misinformation Content

Why is YouTube Broadcasting Climate Misinformation to Millions?

Feb 2019 · 2 informes
Incidente AnteriorSiguiente Incidente

Incidentes Similares

Por similitud de texto

Did our AI mess up? Flag the unrelated incidents

Robot in Chinese Shopping Mall Fell off the Escalator, Knocking down Passengers

Shopping mall robot fell off the escalator and knocked down passengers

Dec 2020 · 2 informes
Student-Developed Facial Recognition App Raised Ethical Concerns

AI Incident Database Incidents Converted to Issues

Oct 2021 · 1 informe
YouTube’s Recommendation Algorithm Allegedly Promoted Climate Misinformation Content

Why is YouTube Broadcasting Climate Misinformation to Millions?

Feb 2019 · 2 informes

Investigación

  • Definición de un “Incidente de IA”
  • Definición de una “Respuesta a incidentes de IA”
  • Hoja de ruta de la base de datos
  • Trabajo relacionado
  • Descargar Base de Datos Completa

Proyecto y Comunidad

  • Acerca de
  • Contactar y Seguir
  • Aplicaciones y resúmenes
  • Guía del editor

Incidencias

  • Todos los incidentes en forma de lista
  • Incidentes marcados
  • Cola de envío
  • Vista de clasificaciones
  • Taxonomías

2024 - AI Incident Database

  • Condiciones de uso
  • Política de privacidad
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • 86fe0f5