social media users
Incidents Harmed By
Incident 49911 Report
Parody AI Images of Donald Trump Being Arrested Reposted as Misinformation
2023-03-21
AI-generated photorealistic images depicting Donald Trump being detained by the police which were originally posted on Twitter as parody were unintentionally shared across social media platforms as factual news, lacking the intended context.
MoreIncident 26710 Report
Clearview AI Algorithm Built on Photos Scraped from Social Media Profiles without Consent
2017-06-15
Face-matching algorithm by Clearview AI was built using scraped images from social media sites such as Instagram and Facebook without user consent, violating social media site policies, and allegedly privacy regulations.
MoreIncident 9396 Report
AI-Powered Chinese Surveillance Campaign 'Peer Review' Used for Real-Time Monitoring of Anti-State Speech on Western Social Media
2025-02-21
OpenAI reportedly uncovered evidence of a Chinese state-linked AI-powered surveillance campaign, dubbed "Peer Review," designed to monitor and report anti-state speech on Western social media in real time. The system, believed to be built on Meta’s open-source Llama model, was detected when a developer allegedly used OpenAI’s technology to debug its code. OpenAI also reportedly identified disinformation efforts targeting Chinese dissidents and spreading propaganda in Latin America.
MoreIncident 10545 Report
Anthropic Report Details Claude Misuse for Influence Operations, Credential Stuffing, Recruitment Fraud, and Malware Development
2025-04-23
In April 2025, Anthropic published a report detailing several misuse cases involving its Claude LLM, all detected in March. These included an "influence-as-a-service" operation that orchestrated over 100 social media bots; an effort to scrape and test leaked credentials for security camera access; a recruitment fraud campaign targeting Eastern Europe; and a novice actor developing sophisticated malware. Anthropic banned the accounts involved but could not confirm downstream deployment.
MoreIncidents involved as Deployer
Incident 8902 Report
AI-Generated Images of the Iconic Hollywood Sign Reportedly on Fire Circulating on Social Media
2025-01-08
During the January 2025 Southern California wildfires, AI-generated images of the iconic Hollywood Sign being on fire circulated on social media.
MoreIncident 10022 Report
Manipulated Video Using AI-Generated Audio Targets Pakistan's Prime Minister Shehbaz Sharif with Fabricated Interview
2025-03-23
A viral video falsely claimed to show Layal al-Ekhtiar of Al Arabiya confronting Pakistan's Prime Minister Shehbaz Sharif over funding a 30-person Umrah delegation with public money while seeking aid from Saudi Arabia. Investigators concluded the video had been dubbed with AI-generated audio. The original interview was broadcast by Saudi-owned Al Arabiya in January 2023, and it contained no such exchange. Lip-sync inconsistencies reportedly confirmed the manipulation.
More