Unknown generative AI systems
Incidents implicated systems
Incident 11254 Report
Reported Use and Circulation of AI-Generated Misinformation and Fake Victim Visuals After Air India 171 Crash
2025-06-12
Following the June 12, 2025 crash of Air India Flight 171, bad-faith actors reportedly used generative AI to produce fake videos and images misrepresenting victims and dramatizing the event. These AI-generated fakes spread widely on social media during the investigation delay, reportedly confusing even aviation professionals and misleading the public. Experts warned that the misuse exploited the grief of victims' families and amplified misinformation about the tragedy.
MoreIncident 12754 Report
Purportedly AI-Enhanced Phishing Campaign Allegedly Impersonates Australian Government Services in Large-Scale Welfare Scam
2025-11-17
A large-scale phishing campaign allegedly impersonating Services Australia and Centrelink reportedly sent more than 270,000 fraudulent emails in 2025. Mimecast analysts reportedly say attackers (designated MCTO3001) used AI tools to generate highly convincing government-themed messages and evasion techniques, targeting vulnerable Australians and public institutions. Victims reportedly faced risks of credential theft and downstream digital exploitation.
MoreIncident 13244 Report
Pieces Technologies' Clinical AI Systems Allegedly Marketed With Misleading Performance Claims
2024-09-18
The Texas Attorney General announced a settlement with Pieces Technologies following allegations that the company misrepresented the accuracy of its healthcare AI systems used for clinical documentation. The state concluded that marketing claims about low error and hallucination rates may have misled hospitals and clinicians relying on the tools in patient care settings. The settlement imposed restrictions on future claims and required greater transparency around performance and risk.
MoreIncident 14444 Report
Hachette Reportedly Canceled Publication of Mia Ballard's Shy Girl After Generative AI Authorship Allegations
2026-03-19
Hachette Book Group reportedly canceled U.S. publication of Mia Ballard's horror novel Shy Girl and said its Wildfire imprint would not continue publishing the U.K. edition after investigating allegations that parts of the book were generated with AI. Ballard reportedly said she did not personally use AI and suggested an editor of an earlier self-published version may have done so.
MoreRelated Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
Related Entities
Social media actors exploiting the Air India Flight 171 disaster
Incidents involved as Deployer
Unidentified Israeli government contractor under close supervision
Incidents involved as Deployer
Journalistic integrity
Incidents Harmed By
- Incident 12902 Reports
Alleged Fabricated News Sites and Deepfakes Impersonated Maltese Ministers, Financial Experts, and Media to Promote NethertoxAGENT Fraud
- Incident 12211 Report
Alleged AI-Enabled PRISONBREAK Influence Operation on X Reportedly Synchronizes Deepfake of Evin Prison Strike with Ongoing Attacks in Tehran
Springer Nature
Incidents involved as Deployer
- Incident 13081 Report
Springer Nature Book 'Mastering Machine Learning: From Basics to Advanced' Reportedly Published With Numerous Purportedly Nonexistent or Incorrect Citations
- Incident 13091 Report
Springer Nature Book 'Social, Ethical and Legal Aspects of Generative AI: Tools, Techniques and Systems' Reportedly Published With Numerous Purportedly Fabricated or Unverifiable Citations
Large language model developers
Incidents involved as Developer
- Incident 14444 Reports
Hachette Reportedly Canceled Publication of Mia Ballard's Shy Girl After Generative AI Authorship Allegations
- Incident 14474 Reports
Sixth Circuit Sanctioned Lawyers in Whiting v. City of Athens over Alleged Fake Appellate Citations in Briefs Reportedly Bearing Hallmarks of Hallucinations
Academic researchers
Incidents Harmed By
- Incident 13081 Report
Springer Nature Book 'Mastering Machine Learning: From Basics to Advanced' Reportedly Published With Numerous Purportedly Nonexistent or Incorrect Citations
- Incident 13091 Report
Springer Nature Book 'Social, Ethical and Legal Aspects of Generative AI: Tools, Techniques and Systems' Reportedly Published With Numerous Purportedly Fabricated or Unverifiable Citations
Minors
Incidents Harmed By
- Incident 14482 Reports
Ohio Man Pleaded Guilty after Prosecutors Alleged He Used AI to Create and Distribute Nonconsensual Intimate-Image Forgeries Including CSAM in Harassment Campaign
- Incident 13181 Report
School's Suspected AI-Cheating Allegation Precedes Student's Reported Suicide in Greater Noida, India
Image generation technology developers
Incidents involved as Developer
- Incident 13303 Reports
Purportedly AI-Generated 'Eric Langford' Missing Boy Scout Hoax Circulating Across Multiple Social Media Platforms
- Incident 14482 Reports
Ohio Man Pleaded Guilty after Prosecutors Alleged He Used AI to Create and Distribute Nonconsensual Intimate-Image Forgeries Including CSAM in Harassment Campaign