WhatsApp users
Incidents Harmed By
Incident 10402 Report
Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas
2025-04-26
Third-party testing of Meta's AI chatbot services on Instagram, Facebook, and WhatsApp reportedly found that both official and user-created bots engaged in sexually explicit roleplaying with accounts identifying as minors. Some bots, including those reportedly using licensed celebrity voices, allegedly escalated conversations into graphic scenarios. Meta subsequently adjusted some safeguards but reportedly continued allowing certain forms of roleplaying involving underage personas.
MoreIncident 12191 Report
Meta Platforms Users Report Being Wrongfully Locked Out After Purported AI Moderation Flags Accounts for Child Exploitation Content
2025-07-02
Multiple Meta users reported being wrongfully locked out of Instagram, Facebook, and WhatsApp accounts after automated systems allegedly flagged them for child exploitation content. The users reportedly deny wrongdoing and lost personal and business data. Experts cited overreliance on AI moderation as a likely cause. Meta has not publicly explained or remediated the suspensions.
MoreIncident 15701 Report
Purported Deepfake Impersonating Dubai Crown Prince Reportedly Used to Defraud Filipino Domestic Worker
2026-07-03
A Filipino domestic worker identified as "Maria" reportedly paid ₱100,000 (about $1,625) after a scammer deployed purportedly manipulated real-time video to impersonate Dubai Crown Prince Hamdan bin Mohammed during WhatsApp calls. The scammer reportedly claimed the money was for a marriage certificate and "royal membership card" that would help her secure a job in Dubai. Maria reportedly ended contact after noticing that the Facebook account was based in Nigeria.
MoreRelated Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
Related Entities
Meta
Incidents involved as both Developer and Deployer
- Incident 10402 Reports
Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas
- Incident 12191 Report
Meta Platforms Users Report Being Wrongfully Locked Out After Purported AI Moderation Flags Accounts for Child Exploitation Content
Incidents implicated systems
Meta users
Incidents Harmed By
- Incident 10402 Reports
Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas
- Incident 12191 Report
Meta Platforms Users Report Being Wrongfully Locked Out After Purported AI Moderation Flags Accounts for Child Exploitation Content
Instagram users
Incidents Harmed By
- Incident 10402 Reports
Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas
- Incident 12191 Report
Meta Platforms Users Report Being Wrongfully Locked Out After Purported AI Moderation Flags Accounts for Child Exploitation Content
Facebook users
Incidents Harmed By
- Incident 10402 Reports
Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas
- Incident 12191 Report
Meta Platforms Users Report Being Wrongfully Locked Out After Purported AI Moderation Flags Accounts for Child Exploitation Content