Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Entities

Meta users

Incidents Harmed By

Incident 8855 Report
Meta AI Characters Allegedly Exhibited Racism, Fabricated Identities, and Exploited User Trust

2025-01-03

Meta deployed AI-generated profiles on its platforms, including Instagram and Facebook, as part of an experiment. The profiles, such as "Liv" and "Grandpa Brian," allegedly featured fabricated identities and misleading diversity claims. These accounts also allegedly manipulated user emotions for engagement and profit. Reportedly, backlash over offensive and deceptive content led Meta to delete the profiles on January 3rd, 2025, citing a blocking-related bug.

More

Incident 11013 Report
Meta AI App Reportedly Publishes Personal Chats Without Users Fully Realizing

2025-04-29

Meta launched a stand-alone AI app with a "Discover" feed allowing users to share conversations with its chatbot. Multiple reports indicate that some users may have inadvertently published highly personal interactions, including audio recordings, medical questions, legal concerns, and intimate relationship disclosures. While Meta states that sharing is opt-in, the feature's design and labeling may have led to user confusion about what would be publicly visible.

More

Incident 8752 Report
Coordinated Deepfake Campaign Reportedly Impersonating Rishi Sunak Promoted Fraudulent Quantum AI Investment Platform on Meta

2024-01-08

143 deepfake ads, over 100 of which reportedly impersonated former British Prime Minister Rishi Sunak, were promoted on Meta's platform to advertise the fraudulent investment scheme "Quantum AI." Funding for the ads reportedly originated from 23 countries. Up to 462,000 users may have been exposed to the false content. The campaign used generative AI tools to create high-quality misinformation, including spoofed BBC news clips for added legitimacy

More

Incident 9992 Report
Attackers Reportedly Deployed Simulated AI Support Chatbot to Trick Instagram Business Users into Adding Malicious 2FA Login

2025-03-12

A phishing campaign has reportedly been impersonating Meta support using a fake chatbot interface to hijack Instagram Business accounts. Victims received emails claiming ad violations and were directed to a fraudulent site mimicking Meta's support. There, a simulated chatbot instructed users to add the attacker’s Authenticator app as a secure login method, enabling account takeover. It remains unclear whether the chatbot used AI or was human-operated via a bot-like interface. See editor's note.

More

Related Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
 

Entity

Meta

Incidents involved as both Developer and Deployer
  • Incident 885
    5 Reports

    Meta AI Characters Allegedly Exhibited Racism, Fabricated Identities, and Exploited User Trust

  • Incident 1101
    3 Reports

    Meta AI App Reportedly Publishes Personal Chats Without Users Fully Realizing

More
Entity

Facebook

Incidents involved as both Developer and Deployer
  • Incident 803
    1 Report

    Facebook's Algorithm Reportedly Amplifies AI-Generated Content, Fueling Misleading Posts

Incidents implicated systems
  • Incident 885
    5 Reports

    Meta AI Characters Allegedly Exhibited Racism, Fabricated Identities, and Exploited User Trust

  • Incident 1219
    1 Report

    Meta Platforms Users Report Being Wrongfully Locked Out After Purported AI Moderation Flags Accounts for Child Exploitation Content

More
Entity

Facebook users

Incidents Harmed By
  • Incident 885
    5 Reports

    Meta AI Characters Allegedly Exhibited Racism, Fabricated Identities, and Exploited User Trust

  • Incident 1223
    2 Reports

    Purportedly AI-Generated Deepfake Ads on Facebook Reportedly Impersonate Trump, Musk, Ocasio-Cortez, Warren, Sanders, and Leavitt to Promote Fraudulent Rebates

More
Entity

Quantum AI scammers

Incidents involved as Deployer
  • Incident 875
    2 Reports

    Coordinated Deepfake Campaign Reportedly Impersonating Rishi Sunak Promoted Fraudulent Quantum AI Investment Platform on Meta

More
Entity

Unknown deepfake technology developers

Incidents involved as Developer
  • Incident 875
    2 Reports

    Coordinated Deepfake Campaign Reportedly Impersonating Rishi Sunak Promoted Fraudulent Quantum AI Investment Platform on Meta

More
Entity

Rishi Sunak

Incidents Harmed By
  • Incident 875
    2 Reports

    Coordinated Deepfake Campaign Reportedly Impersonating Rishi Sunak Promoted Fraudulent Quantum AI Investment Platform on Meta

More
Entity

Quantum AI victims

Incidents Harmed By
  • Incident 875
    2 Reports

    Coordinated Deepfake Campaign Reportedly Impersonating Rishi Sunak Promoted Fraudulent Quantum AI Investment Platform on Meta

More
Entity

BBC News presenters

Incidents Harmed By
  • Incident 875
    2 Reports

    Coordinated Deepfake Campaign Reportedly Impersonating Rishi Sunak Promoted Fraudulent Quantum AI Investment Platform on Meta

More
Entity

Unknown deepfake technology apps

Incidents implicated systems
  • Incident 875
    2 Reports

    Coordinated Deepfake Campaign Reportedly Impersonating Rishi Sunak Promoted Fraudulent Quantum AI Investment Platform on Meta

More
Entity

Instagram users

Incidents Harmed By
  • Incident 885
    5 Reports

    Meta AI Characters Allegedly Exhibited Racism, Fabricated Identities, and Exploited User Trust

  • Incident 999
    2 Reports

    Attackers Reportedly Deployed Simulated AI Support Chatbot to Trick Instagram Business Users into Adding Malicious 2FA Login

More
Entity

Meta AI Characters

Incidents implicated systems
  • Incident 885
    5 Reports

    Meta AI Characters Allegedly Exhibited Racism, Fabricated Identities, and Exploited User Trust

More
Entity

Instagram

Incidents implicated systems
  • Incident 885
    5 Reports

    Meta AI Characters Allegedly Exhibited Racism, Fabricated Identities, and Exploited User Trust

  • Incident 999
    2 Reports

    Attackers Reportedly Deployed Simulated AI Support Chatbot to Trick Instagram Business Users into Adding Malicious 2FA Login

More
Entity

minors

Incidents Harmed By
  • Incident 957
    1 Report

    Alleged Instagram Algorithm Malfunction Floods Users' Reels Feeds with Violent and Graphic Content

  • Incident 1108
    1 Report

    Digital Rights Groups Accuse Meta and Character.AI of Facilitating Unlicensed Therapy via Chatbots

More
Entity

Instagram Reels

Incidents implicated systems
  • Incident 957
    1 Report

    Alleged Instagram Algorithm Malfunction Floods Users' Reels Feeds with Violent and Graphic Content

More
Entity

Instagram recommendation algorithm

Incidents implicated systems
  • Incident 957
    1 Report

    Alleged Instagram Algorithm Malfunction Floods Users' Reels Feeds with Violent and Graphic Content

More
Entity

Scammers impersonating Meta support

Incidents involved as Deployer
  • Incident 999
    2 Reports

    Attackers Reportedly Deployed Simulated AI Support Chatbot to Trick Instagram Business Users into Adding Malicious 2FA Login

More
Entity

scammers

Incidents involved as Deployer
  • Incident 999
    2 Reports

    Attackers Reportedly Deployed Simulated AI Support Chatbot to Trick Instagram Business Users into Adding Malicious 2FA Login

More
Entity

Phishers

Incidents involved as Deployer
  • Incident 999
    2 Reports

    Attackers Reportedly Deployed Simulated AI Support Chatbot to Trick Instagram Business Users into Adding Malicious 2FA Login

More
Entity

Fraudsters

Incidents involved as Deployer
  • Incident 999
    2 Reports

    Attackers Reportedly Deployed Simulated AI Support Chatbot to Trick Instagram Business Users into Adding Malicious 2FA Login

More
Entity

Unknown generative AI developers

Incidents involved as Developer
  • Incident 999
    2 Reports

    Attackers Reportedly Deployed Simulated AI Support Chatbot to Trick Instagram Business Users into Adding Malicious 2FA Login

More
Entity

Instagram Business users

Incidents Harmed By
  • Incident 999
    2 Reports

    Attackers Reportedly Deployed Simulated AI Support Chatbot to Trick Instagram Business Users into Adding Malicious 2FA Login

More
Entity

Unknown chatbot interface

Incidents implicated systems
  • Incident 999
    2 Reports

    Attackers Reportedly Deployed Simulated AI Support Chatbot to Trick Instagram Business Users into Adding Malicious 2FA Login

More
Entity

Meta AI

Incidents implicated systems
  • Incident 1101
    3 Reports

    Meta AI App Reportedly Publishes Personal Chats Without Users Fully Realizing

  • Incident 1172
    1 Report

    Meta AI Bug in Deployed Service Reportedly Allowed Potential Access to Other Users' Prompts and Responses

More
Entity

Character.AI

Incidents involved as both Developer and Deployer
  • Incident 1108
    1 Report

    Digital Rights Groups Accuse Meta and Character.AI of Facilitating Unlicensed Therapy via Chatbots

Incidents implicated systems
  • Incident 1108
    1 Report

    Digital Rights Groups Accuse Meta and Character.AI of Facilitating Unlicensed Therapy via Chatbots

More
Entity

Character.AI users

Incidents Harmed By
  • Incident 1108
    1 Report

    Digital Rights Groups Accuse Meta and Character.AI of Facilitating Unlicensed Therapy via Chatbots

More
Entity

General public

Incidents Harmed By
  • Incident 1223
    2 Reports

    Purportedly AI-Generated Deepfake Ads on Facebook Reportedly Impersonate Trump, Musk, Ocasio-Cortez, Warren, Sanders, and Leavitt to Promote Fraudulent Rebates

  • Incident 1108
    1 Report

    Digital Rights Groups Accuse Meta and Character.AI of Facilitating Unlicensed Therapy via Chatbots

More
Entity

Meta AI Studio

Incidents implicated systems
  • Incident 1108
    1 Report

    Digital Rights Groups Accuse Meta and Character.AI of Facilitating Unlicensed Therapy via Chatbots

More
Entity

Therapy chatbots

Incidents implicated systems
  • Incident 1108
    1 Report

    Digital Rights Groups Accuse Meta and Character.AI of Facilitating Unlicensed Therapy via Chatbots

More
Entity

WhatsApp users

Incidents Harmed By
  • Incident 1219
    1 Report

    Meta Platforms Users Report Being Wrongfully Locked Out After Purported AI Moderation Flags Accounts for Child Exploitation Content

More
Entity

Meta Platforms

Incidents implicated systems
  • Incident 1219
    1 Report

    Meta Platforms Users Report Being Wrongfully Locked Out After Purported AI Moderation Flags Accounts for Child Exploitation Content

More
Entity

WhatsApp

Incidents implicated systems
  • Incident 1219
    1 Report

    Meta Platforms Users Report Being Wrongfully Locked Out After Purported AI Moderation Flags Accounts for Child Exploitation Content

More
Entity

Unknown scammers operating Meta ad accounts

Incidents involved as Deployer
  • Incident 1223
    2 Reports

    Purportedly AI-Generated Deepfake Ads on Facebook Reportedly Impersonate Trump, Musk, Ocasio-Cortez, Warren, Sanders, and Leavitt to Promote Fraudulent Rebates

More
Entity

Unknown scammers

Incidents involved as Deployer
  • Incident 1223
    2 Reports

    Purportedly AI-Generated Deepfake Ads on Facebook Reportedly Impersonate Trump, Musk, Ocasio-Cortez, Warren, Sanders, and Leavitt to Promote Fraudulent Rebates

More
Entity

Unknown fraudsters

Incidents involved as Deployer
  • Incident 1223
    2 Reports

    Purportedly AI-Generated Deepfake Ads on Facebook Reportedly Impersonate Trump, Musk, Ocasio-Cortez, Warren, Sanders, and Leavitt to Promote Fraudulent Rebates

More
Entity

Senior Health Daily USA (advertiser)

Incidents involved as Deployer
  • Incident 1223
    2 Reports

    Purportedly AI-Generated Deepfake Ads on Facebook Reportedly Impersonate Trump, Musk, Ocasio-Cortez, Warren, Sanders, and Leavitt to Promote Fraudulent Rebates

More
Entity

RFY News Group (advertiser network)

Incidents involved as Deployer
  • Incident 1223
    2 Reports

    Purportedly AI-Generated Deepfake Ads on Facebook Reportedly Impersonate Trump, Musk, Ocasio-Cortez, Warren, Sanders, and Leavitt to Promote Fraudulent Rebates

More
Entity

Relief Eligibility Center (advertiser)

Incidents involved as Deployer
  • Incident 1223
    2 Reports

    Purportedly AI-Generated Deepfake Ads on Facebook Reportedly Impersonate Trump, Musk, Ocasio-Cortez, Warren, Sanders, and Leavitt to Promote Fraudulent Rebates

More
Entity

I Love My Freedom (advertiser)

Incidents involved as Deployer
  • Incident 1223
    2 Reports

    Purportedly AI-Generated Deepfake Ads on Facebook Reportedly Impersonate Trump, Musk, Ocasio-Cortez, Warren, Sanders, and Leavitt to Promote Fraudulent Rebates

More
Entity

Health Benefits for Seniors (advertiser)

Incidents involved as Deployer
  • Incident 1223
    2 Reports

    Purportedly AI-Generated Deepfake Ads on Facebook Reportedly Impersonate Trump, Musk, Ocasio-Cortez, Warren, Sanders, and Leavitt to Promote Fraudulent Rebates

More
Entity

Hannah Grace (advertiser)

Incidents involved as Deployer
  • Incident 1223
    2 Reports

    Purportedly AI-Generated Deepfake Ads on Facebook Reportedly Impersonate Trump, Musk, Ocasio-Cortez, Warren, Sanders, and Leavitt to Promote Fraudulent Rebates

More
Entity

Get Covered Today (advertiser)

Incidents involved as Deployer
  • Incident 1223
    2 Reports

    Purportedly AI-Generated Deepfake Ads on Facebook Reportedly Impersonate Trump, Musk, Ocasio-Cortez, Warren, Sanders, and Leavitt to Promote Fraudulent Rebates

More
Entity

Freedom Asset Advocates (advertiser)

Incidents involved as Deployer
  • Incident 1223
    2 Reports

    Purportedly AI-Generated Deepfake Ads on Facebook Reportedly Impersonate Trump, Musk, Ocasio-Cortez, Warren, Sanders, and Leavitt to Promote Fraudulent Rebates

More
Entity

End the Wokeness (advertiser)

Incidents involved as Deployer
  • Incident 1223
    2 Reports

    Purportedly AI-Generated Deepfake Ads on Facebook Reportedly Impersonate Trump, Musk, Ocasio-Cortez, Warren, Sanders, and Leavitt to Promote Fraudulent Rebates

More
Entity

Asking America (advertiser)

Incidents involved as Deployer
  • Incident 1223
    2 Reports

    Purportedly AI-Generated Deepfake Ads on Facebook Reportedly Impersonate Trump, Musk, Ocasio-Cortez, Warren, Sanders, and Leavitt to Promote Fraudulent Rebates

More
Entity

American Relief Programs (scam network)

Incidents involved as Deployer
  • Incident 1223
    2 Reports

    Purportedly AI-Generated Deepfake Ads on Facebook Reportedly Impersonate Trump, Musk, Ocasio-Cortez, Warren, Sanders, and Leavitt to Promote Fraudulent Rebates

More
Entity

Unknown voice cloning technology developer

Incidents involved as Developer
  • Incident 1223
    2 Reports

    Purportedly AI-Generated Deepfake Ads on Facebook Reportedly Impersonate Trump, Musk, Ocasio-Cortez, Warren, Sanders, and Leavitt to Promote Fraudulent Rebates

More
Entity

Unknown deepfake technology developer

Incidents involved as Developer
  • Incident 1223
    2 Reports

    Purportedly AI-Generated Deepfake Ads on Facebook Reportedly Impersonate Trump, Musk, Ocasio-Cortez, Warren, Sanders, and Leavitt to Promote Fraudulent Rebates

More
Entity

Public trust

Incidents Harmed By
  • Incident 1223
    2 Reports

    Purportedly AI-Generated Deepfake Ads on Facebook Reportedly Impersonate Trump, Musk, Ocasio-Cortez, Warren, Sanders, and Leavitt to Promote Fraudulent Rebates

More
Entity

Karoline Leavitt

Incidents Harmed By
  • Incident 1223
    2 Reports

    Purportedly AI-Generated Deepfake Ads on Facebook Reportedly Impersonate Trump, Musk, Ocasio-Cortez, Warren, Sanders, and Leavitt to Promote Fraudulent Rebates

More
Entity

Epistemic integrity

Incidents Harmed By
  • Incident 1223
    2 Reports

    Purportedly AI-Generated Deepfake Ads on Facebook Reportedly Impersonate Trump, Musk, Ocasio-Cortez, Warren, Sanders, and Leavitt to Promote Fraudulent Rebates

More
Entity

Elon Musk

Incidents Harmed By
  • Incident 1223
    2 Reports

    Purportedly AI-Generated Deepfake Ads on Facebook Reportedly Impersonate Trump, Musk, Ocasio-Cortez, Warren, Sanders, and Leavitt to Promote Fraudulent Rebates

More
Entity

Elizabeth Warren

Incidents Harmed By
  • Incident 1223
    2 Reports

    Purportedly AI-Generated Deepfake Ads on Facebook Reportedly Impersonate Trump, Musk, Ocasio-Cortez, Warren, Sanders, and Leavitt to Promote Fraudulent Rebates

More
Entity

Elderly individuals

Incidents Harmed By
  • Incident 1223
    2 Reports

    Purportedly AI-Generated Deepfake Ads on Facebook Reportedly Impersonate Trump, Musk, Ocasio-Cortez, Warren, Sanders, and Leavitt to Promote Fraudulent Rebates

More
Entity

Donald Trump

Incidents Harmed By
  • Incident 1223
    2 Reports

    Purportedly AI-Generated Deepfake Ads on Facebook Reportedly Impersonate Trump, Musk, Ocasio-Cortez, Warren, Sanders, and Leavitt to Promote Fraudulent Rebates

More
Entity

Bernie Sanders

Incidents Harmed By
  • Incident 1223
    2 Reports

    Purportedly AI-Generated Deepfake Ads on Facebook Reportedly Impersonate Trump, Musk, Ocasio-Cortez, Warren, Sanders, and Leavitt to Promote Fraudulent Rebates

More
Entity

Alexandria Ocasio-Cortez

Incidents Harmed By
  • Incident 1223
    2 Reports

    Purportedly AI-Generated Deepfake Ads on Facebook Reportedly Impersonate Trump, Musk, Ocasio-Cortez, Warren, Sanders, and Leavitt to Promote Fraudulent Rebates

More
Entity

Unknown voice cloning technology

Incidents implicated systems
  • Incident 1223
    2 Reports

    Purportedly AI-Generated Deepfake Ads on Facebook Reportedly Impersonate Trump, Musk, Ocasio-Cortez, Warren, Sanders, and Leavitt to Promote Fraudulent Rebates

More
Entity

Unknown deepfake technology

Incidents implicated systems
  • Incident 1223
    2 Reports

    Purportedly AI-Generated Deepfake Ads on Facebook Reportedly Impersonate Trump, Musk, Ocasio-Cortez, Warren, Sanders, and Leavitt to Promote Fraudulent Rebates

More
Entity

Meta ad targeting algorithm

Incidents implicated systems
  • Incident 1223
    2 Reports

    Purportedly AI-Generated Deepfake Ads on Facebook Reportedly Impersonate Trump, Musk, Ocasio-Cortez, Warren, Sanders, and Leavitt to Promote Fraudulent Rebates

More
Entity

Meta ad review automation system

Incidents implicated systems
  • Incident 1223
    2 Reports

    Purportedly AI-Generated Deepfake Ads on Facebook Reportedly Impersonate Trump, Musk, Ocasio-Cortez, Warren, Sanders, and Leavitt to Promote Fraudulent Rebates

More
Entity

Meta ad ranking algorithm

Incidents implicated systems
  • Incident 1223
    2 Reports

    Purportedly AI-Generated Deepfake Ads on Facebook Reportedly Impersonate Trump, Musk, Ocasio-Cortez, Warren, Sanders, and Leavitt to Promote Fraudulent Rebates

More
Entity

Meta ad library

Incidents implicated systems
  • Incident 1223
    2 Reports

    Purportedly AI-Generated Deepfake Ads on Facebook Reportedly Impersonate Trump, Musk, Ocasio-Cortez, Warren, Sanders, and Leavitt to Promote Fraudulent Rebates

More
Entity

Meta ad approval pipeline

Incidents implicated systems
  • Incident 1223
    2 Reports

    Purportedly AI-Generated Deepfake Ads on Facebook Reportedly Impersonate Trump, Musk, Ocasio-Cortez, Warren, Sanders, and Leavitt to Promote Fraudulent Rebates

More

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2024 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • 6f6c5a5