Skip to Content
logologo
AI Incident Database
Donate
Discover
Submit
  • Welcome to the AIID
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Spatial View
  • Blog
  • AI News Digest
  • Random Incident
  • Sign Up
Discover
Submit
  • Welcome to the AIID
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Spatial View
  • Blog
  • AI News Digest
  • Random Incident
  • Sign Up
Entities

Asian women

Incidents Harmed By

Incident 4235 Report
Lensa AI's Produced Unintended Sexually Explicit or Suggestive "Magic Avatars" for Women

2022-11-22

Lensa AI's "Magic Avatars" were reportedly generating sexually explicit and sexualized features disproportionately for women and Asian women despite not submitting any sexual content.

More

Incident 4383 Report
Henan Authorities Reportedly Commissioned Facial Recognition System to Track Journalists and International Students

2021-09-17

Henan Public Security Department procurement documents reportedly described a surveillance system awarded to Neusoft on September 17, 2021. The planned system would allegedly use about 3,000 facial-recognition cameras linked to regional and national databases to create files and alerts on foreign journalists, international students, and other targeted groups. It could not be confirmed whether the system became operational.

More

Related Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
 

Entity

Lensa AI

Incidents involved as both Developer and Deployer
  • Incident 423
    5 Reports

    Lensa AI's Produced Unintended Sexually Explicit or Suggestive "Magic Avatars" for Women

Incidents implicated systems
  • Incident 423
    5 Reports

    Lensa AI's Produced Unintended Sexually Explicit or Suggestive "Magic Avatars" for Women

More
Entity

Stability AI

Incidents involved as Developer
  • Incident 423
    5 Reports

    Lensa AI's Produced Unintended Sexually Explicit or Suggestive "Magic Avatars" for Women

More
Entity

Runway

Incidents involved as Developer
  • Incident 423
    5 Reports

    Lensa AI's Produced Unintended Sexually Explicit or Suggestive "Magic Avatars" for Women

More
Entity

LAION

Incidents involved as Developer
  • Incident 423
    5 Reports

    Lensa AI's Produced Unintended Sexually Explicit or Suggestive "Magic Avatars" for Women

More
Entity

EleutherAI

Incidents involved as Developer
  • Incident 423
    5 Reports

    Lensa AI's Produced Unintended Sexually Explicit or Suggestive "Magic Avatars" for Women

More
Entity

CompVis LMU

Incidents involved as Developer
  • Incident 423
    5 Reports

    Lensa AI's Produced Unintended Sexually Explicit or Suggestive "Magic Avatars" for Women

More
Entity

Women and girls

Incidents Harmed By
  • Incident 423
    5 Reports

    Lensa AI's Produced Unintended Sexually Explicit or Suggestive "Magic Avatars" for Women

  • Incident 438
    3 Reports

    Henan Authorities Reportedly Commissioned Facial Recognition System to Track Journalists and International Students

More
Entity

Women

Incidents Harmed By
  • Incident 423
    5 Reports

    Lensa AI's Produced Unintended Sexually Explicit or Suggestive "Magic Avatars" for Women

  • Incident 438
    3 Reports

    Henan Authorities Reportedly Commissioned Facial Recognition System to Track Journalists and International Students

More
Entity

Asian people

Incidents Harmed By
  • Incident 423
    5 Reports

    Lensa AI's Produced Unintended Sexually Explicit or Suggestive "Magic Avatars" for Women

  • Incident 438
    3 Reports

    Henan Authorities Reportedly Commissioned Facial Recognition System to Track Journalists and International Students

More
Entity

Lensa AI users

Incidents Harmed By
  • Incident 423
    5 Reports

    Lensa AI's Produced Unintended Sexually Explicit or Suggestive "Magic Avatars" for Women

More
Entity

Henan Public Security Department

Incidents involved as Deployer
  • Incident 438
    3 Reports

    Henan Authorities Reportedly Commissioned Facial Recognition System to Track Journalists and International Students

More
Entity

Government of China

Incidents involved as Deployer
  • Incident 438
    3 Reports

    Henan Authorities Reportedly Commissioned Facial Recognition System to Track Journalists and International Students

More
Entity

Government of Henan

Incidents involved as Deployer
  • Incident 438
    3 Reports

    Henan Authorities Reportedly Commissioned Facial Recognition System to Track Journalists and International Students

More
Entity

Surveillance technology developers

Incidents involved as Developer
  • Incident 438
    3 Reports

    Henan Authorities Reportedly Commissioned Facial Recognition System to Track Journalists and International Students

More
Entity

Neusoft

Incidents involved as Developer
  • Incident 438
    3 Reports

    Henan Authorities Reportedly Commissioned Facial Recognition System to Track Journalists and International Students

More
Entity

Huawei Cloud

Incidents involved as Developer
  • Incident 438
    3 Reports

    Henan Authorities Reportedly Commissioned Facial Recognition System to Track Journalists and International Students

More
Entity

Huawei

Incidents involved as Developer
  • Incident 438
    3 Reports

    Henan Authorities Reportedly Commissioned Facial Recognition System to Track Journalists and International Students

More
Entity

Facial recognition system developers

Incidents involved as Developer
  • Incident 438
    3 Reports

    Henan Authorities Reportedly Commissioned Facial Recognition System to Track Journalists and International Students

More
Entity

Uyghurs

Incidents Harmed By
  • Incident 438
    3 Reports

    Henan Authorities Reportedly Commissioned Facial Recognition System to Track Journalists and International Students

More
Entity

Students

Incidents Harmed By
  • Incident 438
    3 Reports

    Henan Authorities Reportedly Commissioned Facial Recognition System to Track Journalists and International Students

More
Entity

Privacy

Incidents Harmed By
  • Incident 438
    3 Reports

    Henan Authorities Reportedly Commissioned Facial Recognition System to Track Journalists and International Students

More
Entity

Press freedom

Incidents Harmed By
  • Incident 438
    3 Reports

    Henan Authorities Reportedly Commissioned Facial Recognition System to Track Journalists and International Students

More
Entity

Minority groups

Incidents Harmed By
  • Incident 438
    3 Reports

    Henan Authorities Reportedly Commissioned Facial Recognition System to Track Journalists and International Students

More
Entity

Migrant women in Henan

Incidents Harmed By
  • Incident 438
    3 Reports

    Henan Authorities Reportedly Commissioned Facial Recognition System to Track Journalists and International Students

More
Entity

Migrant women in China

Incidents Harmed By
  • Incident 438
    3 Reports

    Henan Authorities Reportedly Commissioned Facial Recognition System to Track Journalists and International Students

More
Entity

Migrant women

Incidents Harmed By
  • Incident 438
    3 Reports

    Henan Authorities Reportedly Commissioned Facial Recognition System to Track Journalists and International Students

More
Entity

Journalists

Incidents Harmed By
  • Incident 438
    3 Reports

    Henan Authorities Reportedly Commissioned Facial Recognition System to Track Journalists and International Students

More
Entity

international students in Henan

Incidents Harmed By
  • Incident 438
    3 Reports

    Henan Authorities Reportedly Commissioned Facial Recognition System to Track Journalists and International Students

More
Entity

Ethnic minorities in China

Incidents Harmed By
  • Incident 438
    3 Reports

    Henan Authorities Reportedly Commissioned Facial Recognition System to Track Journalists and International Students

More
Entity

Educational communities

Incidents Harmed By
  • Incident 438
    3 Reports

    Henan Authorities Reportedly Commissioned Facial Recognition System to Track Journalists and International Students

More
Entity

Biometric data subjects

Incidents Harmed By
  • Incident 438
    3 Reports

    Henan Authorities Reportedly Commissioned Facial Recognition System to Track Journalists and International Students

More
Entity

Traffic-light risk classification systems

Incidents implicated systems
  • Incident 438
    3 Reports

    Henan Authorities Reportedly Commissioned Facial Recognition System to Track Journalists and International Students

More
Entity

Surveillance technology

Incidents implicated systems
  • Incident 438
    3 Reports

    Henan Authorities Reportedly Commissioned Facial Recognition System to Track Journalists and International Students

More
Entity

Surveillance databases

Incidents implicated systems
  • Incident 438
    3 Reports

    Henan Authorities Reportedly Commissioned Facial Recognition System to Track Journalists and International Students

More
Entity

Person-of-interest alert systems

Incidents implicated systems
  • Incident 438
    3 Reports

    Henan Authorities Reportedly Commissioned Facial Recognition System to Track Journalists and International Students

More
Entity

Henan targeted surveillance system

Incidents implicated systems
  • Incident 438
    3 Reports

    Henan Authorities Reportedly Commissioned Facial Recognition System to Track Journalists and International Students

More
Entity

Facial recognition systems

Incidents implicated systems
  • Incident 438
    3 Reports

    Henan Authorities Reportedly Commissioned Facial Recognition System to Track Journalists and International Students

More
Entity

AI-enabled decision support systems

Incidents implicated systems
  • Incident 438
    3 Reports

    Henan Authorities Reportedly Commissioned Facial Recognition System to Track Journalists and International Students

More

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2026 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • dd3f754