Unknown generative AI systems
Incidents implicated systems
Incident 11254 Report
Reported Use and Circulation of AI-Generated Misinformation and Fake Victim Visuals After Air India 171 Crash
2025-06-12
Following the June 12, 2025 crash of Air India Flight 171, bad-faith actors reportedly used generative AI to produce fake videos and images misrepresenting victims and dramatizing the event. These AI-generated fakes spread widely on social media during the investigation delay, reportedly confusing even aviation professionals and misleading the public. Experts warned that the misuse exploited the grief of victims' families and amplified misinformation about the tragedy.
MoreIncident 13244 Report
Pieces Technologies' Clinical AI Systems Allegedly Marketed With Misleading Performance Claims
2024-09-18
The Texas Attorney General announced a settlement with Pieces Technologies following allegations that the company misrepresented the accuracy of its healthcare AI systems used for clinical documentation. The state concluded that marketing claims about low error and hallucination rates may have misled hospitals and clinicians relying on the tools in patient care settings. The settlement imposed restrictions on future claims and required greater transparency around performance and risk.
MoreIncident 4903 Report
Clarkesworld Magazine Reportedly Closed Down Submissions Due to Massive Increase in Purportedly AI-Generated Stories
2023-02-20
Sci-fi magazine Clarkesworld is reported to have temporarily stopped accepting submissions after receiving an overwhelming increase in purportedly LLM-generated submissions.
MoreIncident 12902 Report
Alleged Fabricated News Sites and Deepfakes Impersonated Maltese Ministers, Financial Experts, and Media to Promote NethertoxAGENT Fraud
2025-10-27
Purportedly AI-generated deepfake videos and fabricated news pages impersonating Maltese ministers, journalists, financial experts, and major media outlets reportedly promoted the fraudulent "NethertoxAGENT" investment platform. The scam used synthetic interviews, cloned branding, and falsified testimonials to mislead social media users, reportedly inducing financial losses and prompting law enforcement concern in Malta.
MoreRelated Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
Related Entities
Unknown deepfake technology developers
Incidents involved as Developer
- Incident 12902 Reports
Alleged Fabricated News Sites and Deepfakes Impersonated Maltese Ministers, Financial Experts, and Media to Promote NethertoxAGENT Fraud
- Incident 14482 Reports
Ohio Man Pleaded Guilty after Prosecutors Alleged He Used AI to Create and Distribute Nonconsensual Intimate-Image Forgeries Including CSAM in Harassment Campaign
Unknown deepfake technology
Incidents implicated systems
- Incident 12902 Reports
Alleged Fabricated News Sites and Deepfakes Impersonated Maltese Ministers, Financial Experts, and Media to Promote NethertoxAGENT Fraud
- Incident 14482 Reports
Ohio Man Pleaded Guilty after Prosecutors Alleged He Used AI to Create and Distribute Nonconsensual Intimate-Image Forgeries Including CSAM in Harassment Campaign
Unknown social media actors exploiting the Air India Flight 171 disaster
Incidents involved as Deployer
National security and intelligence stakeholders
Incidents Harmed By
- Incident 12021 Report
Russian Disinformation Campaign Reportedly Used AI-Generated Posts and Videos to Target 2025 Moldovan Parliamentary Elections
- Incident 12211 Report
Alleged AI-Enabled PRISONBREAK Influence Operation on X Reportedly Synchronizes Deepfake of Evin Prison Strike with Ongoing Attacks in Tehran
Unidentified Israeli government contractor under close supervision
Incidents involved as Deployer
Unknown large language models
Incidents implicated systems
- Incident 12952 Reports
Japanese Teen Allegedly Uses AI-Generated Program to Breach Kaikatsu Frontier and Leak Data of 7.3 Million Customers
- Incident 14472 Reports
Sixth Circuit Sanctioned Lawyers in Whiting v. City of Athens over Alleged Fake Appellate Citations in Briefs Reportedly Bearing Hallmarks of Hallucinations
Springer Nature
Incidents involved as Deployer
- Incident 13081 Report
Springer Nature Book 'Mastering Machine Learning: From Basics to Advanced' Reportedly Published With Numerous Purportedly Nonexistent or Incorrect Citations
- Incident 13091 Report
Springer Nature Book 'Social, Ethical and Legal Aspects of Generative AI: Tools, Techniques and Systems' Reportedly Published With Numerous Purportedly Fabricated or Unverifiable Citations
Unknown large language model developers
Incidents involved as Developer
- Incident 14472 Reports
Sixth Circuit Sanctioned Lawyers in Whiting v. City of Athens over Alleged Fake Appellate Citations in Briefs Reportedly Bearing Hallmarks of Hallucinations
- Incident 13081 Report
Springer Nature Book 'Mastering Machine Learning: From Basics to Advanced' Reportedly Published With Numerous Purportedly Nonexistent or Incorrect Citations
Academic researchers
Incidents Harmed By
- Incident 13081 Report
Springer Nature Book 'Mastering Machine Learning: From Basics to Advanced' Reportedly Published With Numerous Purportedly Nonexistent or Incorrect Citations
- Incident 13091 Report
Springer Nature Book 'Social, Ethical and Legal Aspects of Generative AI: Tools, Techniques and Systems' Reportedly Published With Numerous Purportedly Fabricated or Unverifiable Citations
Unknown image generator developers
Incidents involved as Developer
- Incident 14482 Reports
Ohio Man Pleaded Guilty after Prosecutors Alleged He Used AI to Create and Distribute Nonconsensual Intimate-Image Forgeries Including CSAM in Harassment Campaign
- Incident 13211 Report
Shilpa Shetty Alleges AI-Enabled Impersonation and Misuse of Likeness in Mumbai High Court Filing