YouTube
Incidents involved as both Developer and Deployer
Incident 114 Report
Google’s YouTube Kids App Presents Inappropriate Content
2015-05-19
YouTube’s content filtering and recommendation algorithms exposed children to disturbing and inappropriate videos.
MoreIncident 1446 Report
YouTube's AI Mistakenly Banned Chess Channel over Chess Language Misinterpretation
2020-06-28
YouTube's AI-powered hate speech detection system falsely flagged chess content and banned chess creators allegedly due to its misinterpretation of strategy language such as "black," "white," and "attack" as harmful and dangerous.
MoreIncident 2684 Report
Permanent Removal of Social Media Content via Automated Tools Allegedly Prevented Investigative Efforts
2020-03-16
Automated permanent removal of violating social media content, such as terrorism, violent extremism, and hate speech, without archival has allegedly hindered the potential use of this content for investigating serious crimes and hampered efforts in criminal accountability.
MoreIncident 3483 Report
YouTube Recommendation Reportedly Pushed Election Fraud Content to Skeptics Disproportionately
2020-11-01
YouTube's recommendation algorithm allegedly pushed 2020's US Presidential Election fraud content to users most skeptical of the election's legitimacy disproportionately compared to least skeptical users.
MoreIncidents Harmed By
Incident 15343 Report
Google Alleged Outsider Enterprise Used Gemini to Create Phishing Sites for Text-Message Scams
2026-05-01
Google alleged in a civil lawsuit that the China-based network Outsider Enterprise used Gemini and other AI tools to help create phishing websites for large-scale text-message scams impersonating companies and government services. Google said the network coordinated through Telegram, generated thousands of fake sites and fraudulent URLs, sent 2.5 million Android messages during a two-week period in May 2026, and financially scammed hundreds of thousands of people.
MoreIncidents implicated systems
Incident 98315 Report
Scammers Reportedly Used AI Voice Clone and YouTube Footage to Impersonate WPP CEO in Unsuccessful Scam Attempt
2024-05-10
Scammers reportedly attempted to impersonate WPP CEO Mark Read using AI-generated voice cloning and YouTube footage in a Microsoft Teams scam. They allegedly created a fake WhatsApp account with Read’s image and used deepfake audio to deceive an agency leader into setting up a new business. The scheme, which was unsuccessful, aimed to solicit money and personal data.
MoreIncident 6766 Report
Alleged Deepfake Audio Depicts Philippines President Ferdinand Marcos Jr. Ordering Military Action
2024-04-24
A purported deepfake audio clip portraying Philippine President Ferdinand Marcos Jr. ordering an attack on China spread online in July 2024, fueling tensions in the West Philippine Sea. The Presidential Communications Office reportedly debunked it as fake, attributing it to foreign actors.
MoreIncident 16476 Report
AI-Generated Voice Mimicking Taiwan President Lai Ching-te Reportedly Used in Political Video Criticizing Government Food-Safety Response
2026-07-24
A political video titled "It's Out of Your Control" reportedly used an AI-generated voice resembling Taiwan President Lai Ching-te while criticizing the government's response to a cooking-oil safety scandal. Police said the voice could be mistaken for Lai and later confirmed it was AI-generated. Opposition figures defended the video as political expression while prosecutors opened a forgery investigation.
MoreIncident 9654 Report
Phishers Allegedly Using AI-Generated Video of YouTube CEO Neal Mohan to Target Creators
2025-03-04
Scammers are reportedly using an AI-generated deepfake of YouTube CEO Neal Mohan to steal user credentials. The fake video announces false changes to YouTube’s monetization policy, and it then tricks creators into clicking malicious links or downloading malware. The scam spreads through private videos and emails from a fake YouTube address. It exploits platform features to appear legitimate. Victims risk losing account access or exposing sensitive data.
MoreRelated Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
Related Entities
Incidents involved as both Developer and Deployer
- Incident 2684 Reports
Permanent Removal of Social Media Content via Automated Tools Allegedly Prevented Investigative Efforts
- Incident 1682 Reports
Collaborative Filtering Prone to Popularity Bias, Resulting in Overrepresentation of Popular Items in the Recommendation Outputs
Incidents implicated systems
YouTube content creators
Incidents Harmed By
- Incident 2292 Reports
Content Using Bestiality Thumbnails Allegedly Evaded YouTube’s Thumbnail Monitoring System
- Incident 3942 Reports
Social Media's Automated Word-Flagging without Context Shifted Content Creators' Language Use
Incidents involved as Deployer
Philippines-China relations
Incidents Harmed By
- Incident 6766 Reports
Alleged Deepfake Audio Depicts Philippines President Ferdinand Marcos Jr. Ordering Military Action
- Incident 11291 Report
Purported AI-Generated Video Depicting Philippine President Ferdinand Marcos Jr. Using Drugs Shared by Rodrigo Duterte Supporters and Amplified by China-Linked Spamouflage
Government of the Philippines
Incidents Harmed By
- Incident 6766 Reports
Alleged Deepfake Audio Depicts Philippines President Ferdinand Marcos Jr. Ordering Military Action
- Incident 11291 Report
Purported AI-Generated Video Depicting Philippine President Ferdinand Marcos Jr. Using Drugs Shared by Rodrigo Duterte Supporters and Amplified by China-Linked Spamouflage
General public of the Philippines
Incidents Harmed By
- Incident 6766 Reports
Alleged Deepfake Audio Depicts Philippines President Ferdinand Marcos Jr. Ordering Military Action
- Incident 11291 Report
Purported AI-Generated Video Depicting Philippine President Ferdinand Marcos Jr. Using Drugs Shared by Rodrigo Duterte Supporters and Amplified by China-Linked Spamouflage
Ferdinand Marcos Jr.
Incidents Harmed By
- Incident 6766 Reports
Alleged Deepfake Audio Depicts Philippines President Ferdinand Marcos Jr. Ordering Military Action
- Incident 11291 Report
Purported AI-Generated Video Depicting Philippine President Ferdinand Marcos Jr. Using Drugs Shared by Rodrigo Duterte Supporters and Amplified by China-Linked Spamouflage
Synthetic audio generation technology
Incidents involved as Developer
- Incident 98315 Reports
Scammers Reportedly Used AI Voice Clone and YouTube Footage to Impersonate WPP CEO in Unsuccessful Scam Attempt
- Incident 10941 Report
At Least 294 Purported AI-Generated Music Videos Portray Celebrities Praising Burkina Faso's Ibrahim Traoré
Incidents implicated systems
Incidents involved as both Developer and Deployer
- Incident 8731 Report
YouTube Algorithms Allegedly Amplify Eating Disorder Content to Adolescent Girls
Incidents Harmed By
- Incident 15343 Reports
Google Alleged Outsider Enterprise Used Gemini to Create Phishing Sites for Text-Message Scams
- Incident 15343 Reports
Google Alleged Outsider Enterprise Used Gemini to Create Phishing Sites for Text-Message Scams
Incidents involved as Developer
National security and intelligence stakeholders
Incidents Harmed By
- Incident 10941 Report
At Least 294 Purported AI-Generated Music Videos Portray Celebrities Praising Burkina Faso's Ibrahim Traoré
- Incident 11291 Report
Purported AI-Generated Video Depicting Philippine President Ferdinand Marcos Jr. Using Drugs Shared by Rodrigo Duterte Supporters and Amplified by China-Linked Spamouflage