Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Découvrir
Envoyer
  • Bienvenue sur AIID
  • Découvrir les incidents
  • Vue spatiale
  • Vue de tableau
  • Vue de liste
  • Entités
  • Taxonomies
  • Soumettre des rapports d'incident
  • Classement des reporters
  • Blog
  • Résumé de l’Actualité sur l’IA
  • Contrôle des risques
  • Incident au hasard
  • S'inscrire
Fermer
Découvrir
Envoyer
  • Bienvenue sur AIID
  • Découvrir les incidents
  • Vue spatiale
  • Vue de tableau
  • Vue de liste
  • Entités
  • Taxonomies
  • Soumettre des rapports d'incident
  • Classement des reporters
  • Blog
  • Résumé de l’Actualité sur l’IA
  • Contrôle des risques
  • Incident au hasard
  • S'inscrire
Fermer
Entités

Instagram users

Affecté par des incidents

Incident 26710 Rapports
Clearview AI Algorithm Built on Photos Scraped from Social Media Profiles without Consent

2017-06-15

Face-matching algorithm by Clearview AI was built using scraped images from social media sites such as Instagram and Facebook without user consent, violating social media site policies, and allegedly privacy regulations.

Plus

Incident 3246 Rapports
GAN Faces Deployed by The BL's Fake Account Network to Push Pro-Trump Content on Meta Platforms

2019-11-12

A large network of pages, groups, and fake accounts having GAN-generated face photos associated with The BL, a US-based media outlet, reportedly bypassed Facebook moderation systems to push "pro-Trump" narratives on its platform and Instagram.

Plus

Incident 8855 Rapports
Meta AI Characters Allegedly Exhibited Racism, Fabricated Identities, and Exploited User Trust

2025-01-03

Meta deployed AI-generated profiles on its platforms, including Instagram and Facebook, as part of an experiment. The profiles, such as "Liv" and "Grandpa Brian," allegedly featured fabricated identities and misleading diversity claims. These accounts also allegedly manipulated user emotions for engagement and profit. Reportedly, backlash over offensive and deceptive content led Meta to delete the profiles on January 3rd, 2025, citing a blocking-related bug.

Plus

Incident 1904 Rapports
ByteDance Allegedly Trained "For You" Algorithm Using Content Scraped without Consent from Other Social Platforms

2017-01-15

ByteDance allegedly scraped short-form videos, usernames, profile pictures, and descriptions of accounts on Instagram, Snapchat, and other sources, and uploaded them without consent on Flipagram, TikTok’s predecessor, in order to improve its “For You” algorithm's performance on American users.

Plus

Incidents involved as Deployer

Incident 7975 Rapports
Teenager Makes Deepfake Pornography of 50 Girls at Bacchus Marsh Grammar School in Australia

2024-06-07

At Bacchus Marsh Grammar, a school in Victoria state in Australia, an adolescent male made deepfake pornography of 50 girls, ages 9 to 12. He then allegedly uploaded the pictures to Instagram, and others subsequently shared them on Snapchat.

Plus

Entités liées
Autres entités liées au même incident. Par exemple, si le développeur d'un incident est cette entité mais que le responsable de la mise en œuvre est une autre entité, ils sont marqués comme entités liées.
 

Entity

ByteDance

Incidents impliqués en tant que développeur et déployeur
  • Incident 190
    4 Report

    ByteDance Allegedly Trained "For You" Algorithm Using Content Scraped without Consent from Other Social Platforms

Plus
Entity

Snapchat users

Affecté par des incidents
  • Incident 190
    4 Report

    ByteDance Allegedly Trained "For You" Algorithm Using Content Scraped without Consent from Other Social Platforms

Incidents involved as Deployer
  • Incident 797
    5 Report

    Teenager Makes Deepfake Pornography of 50 Girls at Bacchus Marsh Grammar School in Australia

Plus
Entity

American social media users

Affecté par des incidents
  • Incident 190
    4 Report

    ByteDance Allegedly Trained "For You" Algorithm Using Content Scraped without Consent from Other Social Platforms

Plus
Entity

Clearview AI

Incidents impliqués en tant que développeur et déployeur
  • Incident 267
    10 Report

    Clearview AI Algorithm Built on Photos Scraped from Social Media Profiles without Consent

Plus
Entity

social media users

Affecté par des incidents
  • Incident 267
    10 Report

    Clearview AI Algorithm Built on Photos Scraped from Social Media Profiles without Consent

Plus
Entity

Facebook users

Affecté par des incidents
  • Incident 267
    10 Report

    Clearview AI Algorithm Built on Photos Scraped from Social Media Profiles without Consent

  • Incident 324
    6 Report

    GAN Faces Deployed by The BL's Fake Account Network to Push Pro-Trump Content on Meta Platforms

Plus
Entity

Instagram

Incidents impliqués en tant que développeur et déployeur
  • Incident 331
    2 Report

    Bug in Instagram’s “Related Hashtags” Algorithm Allegedly Caused Disproportionate Treatment of Political Hashtags

  • Incident 343
    2 Report

    Facebook, Instagram, and Twitter Failed to Proactively Remove Targeted Racist Remarks via Automated Systems

Incidents involved as Deployer
  • Incident 469
    3 Report

    Automated Adult Content Detection Tools Showed Bias against Women Bodies

  • Incident 723
    2 Report

    Instagram Algorithms Reportedly Directed Children's Merchandise Ad Campaign to Adult Men and Sex Offenders

Incidents implicated systems
  • Incident 885
    5 Report

    Meta AI Characters Allegedly Exhibited Racism, Fabricated Identities, and Exploited User Trust

  • Incident 999
    2 Report

    Attackers Reportedly Deployed Simulated AI Support Chatbot to Trick Instagram Business Users into Adding Malicious 2FA Login

Plus
Entity

The BL

Incidents involved as Deployer
  • Incident 324
    6 Report

    GAN Faces Deployed by The BL's Fake Account Network to Push Pro-Trump Content on Meta Platforms

Plus
Entity

unknown

Incidents involved as Developer
  • Incident 324
    6 Report

    GAN Faces Deployed by The BL's Fake Account Network to Push Pro-Trump Content on Meta Platforms

Plus
Entity

Facebook

Incidents impliqués en tant que développeur et déployeur
  • Incident 343
    2 Report

    Facebook, Instagram, and Twitter Failed to Proactively Remove Targeted Racist Remarks via Automated Systems

  • Incident 359
    1 Report

    Facebook, Instagram, and Twitter Cited Errors in Automated Systems as Cause for Blocking pro-Palestinian Content on Israeli-Palestinian Conflict

Incidents involved as Deployer
  • Incident 469
    3 Report

    Automated Adult Content Detection Tools Showed Bias against Women Bodies

  • Incident 758
    1 Report

    Teen's Overdose Reportedly Linked to Meta's AI Systems Failing to Block Ads for Illegal Drugs

Incidents implicated systems
  • Incident 885
    5 Report

    Meta AI Characters Allegedly Exhibited Racism, Fabricated Identities, and Exploited User Trust

Plus
Entity

Twitter

Incidents impliqués en tant que développeur et déployeur
  • Incident 343
    2 Report

    Facebook, Instagram, and Twitter Failed to Proactively Remove Targeted Racist Remarks via Automated Systems

  • Incident 359
    1 Report

    Facebook, Instagram, and Twitter Cited Errors in Automated Systems as Cause for Blocking pro-Palestinian Content on Israeli-Palestinian Conflict

Plus
Entity

Marcus Rashford

Affecté par des incidents
  • Incident 343
    2 Report

    Facebook, Instagram, and Twitter Failed to Proactively Remove Targeted Racist Remarks via Automated Systems

Plus
Entity

Jadon Sancho

Affecté par des incidents
  • Incident 343
    2 Report

    Facebook, Instagram, and Twitter Failed to Proactively Remove Targeted Racist Remarks via Automated Systems

Plus
Entity

Bukayo Saka

Affecté par des incidents
  • Incident 343
    2 Report

    Facebook, Instagram, and Twitter Failed to Proactively Remove Targeted Racist Remarks via Automated Systems

Plus
Entity

Twitter Users

Affecté par des incidents
  • Incident 343
    2 Report

    Facebook, Instagram, and Twitter Failed to Proactively Remove Targeted Racist Remarks via Automated Systems

  • Incident 359
    1 Report

    Facebook, Instagram, and Twitter Cited Errors in Automated Systems as Cause for Blocking pro-Palestinian Content on Israeli-Palestinian Conflict

Plus
Entity

Palestinian social media users

Affecté par des incidents
  • Incident 359
    1 Report

    Facebook, Instagram, and Twitter Cited Errors in Automated Systems as Cause for Blocking pro-Palestinian Content on Israeli-Palestinian Conflict

Plus
Entity

Facebook employees having families affected by the conflict

Affecté par des incidents
  • Incident 359
    1 Report

    Facebook, Instagram, and Twitter Cited Errors in Automated Systems as Cause for Blocking pro-Palestinian Content on Israeli-Palestinian Conflict

Plus
Entity

Meta

Incidents impliqués en tant que développeur et déployeur
  • Incident 885
    5 Report

    Meta AI Characters Allegedly Exhibited Racism, Fabricated Identities, and Exploited User Trust

  • Incident 723
    2 Report

    Instagram Algorithms Reportedly Directed Children's Merchandise Ad Campaign to Adult Men and Sex Offenders

Incidents involved as Deployer
  • Incident 469
    3 Report

    Automated Adult Content Detection Tools Showed Bias against Women Bodies

Plus
Entity

LinkedIn

Incidents involved as Deployer
  • Incident 469
    3 Report

    Automated Adult Content Detection Tools Showed Bias against Women Bodies

Plus
Entity

Microsoft

Incidents involved as Developer
  • Incident 469
    3 Report

    Automated Adult Content Detection Tools Showed Bias against Women Bodies

Plus
Entity

Google

Incidents involved as Developer
  • Incident 469
    3 Report

    Automated Adult Content Detection Tools Showed Bias against Women Bodies

Plus
Entity

Amazon

Incidents involved as Developer
  • Incident 469
    3 Report

    Automated Adult Content Detection Tools Showed Bias against Women Bodies

Plus
Entity

LinkedIn users

Affecté par des incidents
  • Incident 469
    3 Report

    Automated Adult Content Detection Tools Showed Bias against Women Bodies

Plus
Entity

Instagram sellers

Affecté par des incidents
  • Incident 723
    2 Report

    Instagram Algorithms Reportedly Directed Children's Merchandise Ad Campaign to Adult Men and Sex Offenders

Plus
Entity

Children

Affecté par des incidents
  • Incident 723
    2 Report

    Instagram Algorithms Reportedly Directed Children's Merchandise Ad Campaign to Adult Men and Sex Offenders

  • Incident 788
    1 Report

    Instagram's Algorithm Reportedly Recommended Sexual Content to Teenagers' Accounts

Plus
Entity

Meta Platforms

Incidents impliqués en tant que développeur et déployeur
  • Incident 758
    1 Report

    Teen's Overdose Reportedly Linked to Meta's AI Systems Failing to Block Ads for Illegal Drugs

  • Incident 788
    1 Report

    Instagram's Algorithm Reportedly Recommended Sexual Content to Teenagers' Accounts

Plus
Entity

Elijah Ott

Affecté par des incidents
  • Incident 758
    1 Report

    Teen's Overdose Reportedly Linked to Meta's AI Systems Failing to Block Ads for Illegal Drugs

Plus
Entity

minors

Affecté par des incidents
  • Incident 788
    1 Report

    Instagram's Algorithm Reportedly Recommended Sexual Content to Teenagers' Accounts

  • Incident 957
    1 Report

    Alleged Instagram Algorithm Malfunction Floods Users’ Reels Feeds with Violent and Graphic Content

Plus
Entity

General public

Affecté par des incidents
  • Incident 788
    1 Report

    Instagram's Algorithm Reportedly Recommended Sexual Content to Teenagers' Accounts

  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

Plus
Entity

Unnamed adolescent male

Incidents involved as Deployer
  • Incident 797
    5 Report

    Teenager Makes Deepfake Pornography of 50 Girls at Bacchus Marsh Grammar School in Australia

Plus
Entity

Unknown deepfake technology developer

Incidents involved as Developer
  • Incident 797
    5 Report

    Teenager Makes Deepfake Pornography of 50 Girls at Bacchus Marsh Grammar School in Australia

Plus
Entity

Bacchus Marsh Grammar students

Affecté par des incidents
  • Incident 797
    5 Report

    Teenager Makes Deepfake Pornography of 50 Girls at Bacchus Marsh Grammar School in Australia

Plus
Entity

Bacchus Marsh Grammar girls

Affecté par des incidents
  • Incident 797
    5 Report

    Teenager Makes Deepfake Pornography of 50 Girls at Bacchus Marsh Grammar School in Australia

Plus
Entity

Meta users

Affecté par des incidents
  • Incident 885
    5 Report

    Meta AI Characters Allegedly Exhibited Racism, Fabricated Identities, and Exploited User Trust

  • Incident 999
    2 Report

    Attackers Reportedly Deployed Simulated AI Support Chatbot to Trick Instagram Business Users into Adding Malicious 2FA Login

Plus
Entity

Meta AI Characters

Incidents implicated systems
  • Incident 885
    5 Report

    Meta AI Characters Allegedly Exhibited Racism, Fabricated Identities, and Exploited User Trust

Plus
Entity

Instagram recommendation algorithm

Incidents implicated systems
  • Incident 957
    1 Report

    Alleged Instagram Algorithm Malfunction Floods Users’ Reels Feeds with Violent and Graphic Content

Plus
Entity

Instagram Reels

Incidents implicated systems
  • Incident 957
    1 Report

    Alleged Instagram Algorithm Malfunction Floods Users’ Reels Feeds with Violent and Graphic Content

Plus
Entity

Scammers impersonating Meta support

Incidents involved as Deployer
  • Incident 999
    2 Report

    Attackers Reportedly Deployed Simulated AI Support Chatbot to Trick Instagram Business Users into Adding Malicious 2FA Login

Plus
Entity

scammers

Incidents involved as Deployer
  • Incident 999
    2 Report

    Attackers Reportedly Deployed Simulated AI Support Chatbot to Trick Instagram Business Users into Adding Malicious 2FA Login

Plus
Entity

Phishers

Incidents involved as Deployer
  • Incident 999
    2 Report

    Attackers Reportedly Deployed Simulated AI Support Chatbot to Trick Instagram Business Users into Adding Malicious 2FA Login

Plus
Entity

Fraudsters

Incidents involved as Deployer
  • Incident 999
    2 Report

    Attackers Reportedly Deployed Simulated AI Support Chatbot to Trick Instagram Business Users into Adding Malicious 2FA Login

Plus
Entity

Unknown generative AI developers

Incidents involved as Developer
  • Incident 999
    2 Report

    Attackers Reportedly Deployed Simulated AI Support Chatbot to Trick Instagram Business Users into Adding Malicious 2FA Login

Plus
Entity

Instagram Business users

Affecté par des incidents
  • Incident 999
    2 Report

    Attackers Reportedly Deployed Simulated AI Support Chatbot to Trick Instagram Business Users into Adding Malicious 2FA Login

Plus
Entity

Unknown chatbot interface

Incidents implicated systems
  • Incident 999
    2 Report

    Attackers Reportedly Deployed Simulated AI Support Chatbot to Trick Instagram Business Users into Adding Malicious 2FA Login

Plus
Entity

WhatsApp users

Affecté par des incidents
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

Plus
Entity

Users of Meta platforms

Affecté par des incidents
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

Plus
Entity

WhatsApp Chatbots

Incidents implicated systems
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

Plus
Entity

User-Generated Chatbots

Incidents implicated systems
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

Plus
Entity

Meta Content Moderation Filters

Incidents implicated systems
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

Plus
Entity

Meta AI with Celebrity Voice Skins

Incidents implicated systems
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

Plus
Entity

Meta AI Studio Platform

Incidents implicated systems
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

Plus
Entity

Meta AI Personas

Incidents implicated systems
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

Plus
Entity

Meta AI

Incidents implicated systems
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

Plus
Entity

Meta age verification system

Incidents implicated systems
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

Plus
Entity

Instagram Messaging

Incidents implicated systems
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

Plus
Entity

Facebook Messenger

Incidents implicated systems
  • Incident 1040
    1 Report

    Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas

Plus

Recherche

  • Définition d'un « incident d'IA »
  • Définir une « réponse aux incidents d'IA »
  • Feuille de route de la base de données
  • Travaux connexes
  • Télécharger la base de données complète

Projet et communauté

  • À propos de
  • Contacter et suivre
  • Applications et résumés
  • Guide de l'éditeur

Incidents

  • Tous les incidents sous forme de liste
  • Incidents signalés
  • File d'attente de soumission
  • Affichage des classifications
  • Taxonomies

2024 - AI Incident Database

  • Conditions d'utilisation
  • Politique de confidentialité
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • ecd56df