Unknown generative AI systems
Incidents implicated systems
Incident 11254 Report
Reported Use and Circulation of AI-Generated Misinformation and Fake Victim Visuals After Air India 171 Crash
2025-06-12
Following the June 12, 2025 crash of Air India Flight 171, bad-faith actors reportedly used generative AI to produce fake videos and images misrepresenting victims and dramatizing the event. These AI-generated fakes spread widely on social media during the investigation delay, reportedly confusing even aviation professionals and misleading the public. Experts warned that the misuse exploited the grief of victims' families and amplified misinformation about the tragedy.
MoreIncident 13244 Report
Pieces Technologies' Clinical AI Systems Allegedly Marketed With Misleading Performance Claims
2024-09-18
The Texas Attorney General announced a settlement with Pieces Technologies following allegations that the company misrepresented the accuracy of its healthcare AI systems used for clinical documentation. The state concluded that marketing claims about low error and hallucination rates may have misled hospitals and clinicians relying on the tools in patient care settings. The settlement imposed restrictions on future claims and required greater transparency around performance and risk.
MoreIncident 4903 Report
Clarkesworld Magazine Reportedly Closed Down Submissions Due to Massive Increase in Purportedly AI-Generated Stories
2023-02-20
Sci-fi magazine Clarkesworld is reported to have temporarily stopped accepting submissions after receiving an overwhelming increase in purportedly LLM-generated submissions.
MoreIncident 12952 Report
Japanese Teen Allegedly Uses AI-Generated Program to Breach Kaikatsu Frontier and Leak Data of 7.3 Million Customers
2025-01-18
A 17-year-old boy in Osaka was reportedly served an arrest warrant for allegedly breaching Kaikatsu Frontier's server using a program purportedly generated with a conversational AI tool. The January cyberattack may have exposed personal data of 7.3 million customers and disrupted business operations. Police say the suspect concealed malicious intent when prompting the AI. He was previously arrested for unrelated credit card fraud.
MoreRelated Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
Related Entities
Unknown social media actors exploiting the Air India Flight 171 disaster
Incidents involved as Deployer
National security and intelligence stakeholders
Incidents Harmed By
- Incident 12021 Report
Russian Disinformation Campaign Reportedly Used AI-Generated Posts and Videos to Target 2025 Moldovan Parliamentary Elections
- Incident 12211 Report
Alleged AI-Enabled PRISONBREAK Influence Operation on X Reportedly Synchronizes Deepfake of Evin Prison Strike with Ongoing Attacks in Tehran
Unidentified Israeli government contractor under close supervision
Incidents involved as Deployer
Springer Nature
Incidents involved as Deployer
- Incident 13081 Report
Springer Nature Book 'Mastering Machine Learning: From Basics to Advanced' Reportedly Published With Numerous Purportedly Nonexistent or Incorrect Citations
- Incident 13091 Report
Springer Nature Book 'Social, Ethical and Legal Aspects of Generative AI: Tools, Techniques and Systems' Reportedly Published With Numerous Purportedly Fabricated or Unverifiable Citations
Unknown large language model developers
Incidents involved as Developer
- Incident 13081 Report
Springer Nature Book 'Mastering Machine Learning: From Basics to Advanced' Reportedly Published With Numerous Purportedly Nonexistent or Incorrect Citations
- Incident 13091 Report
Springer Nature Book 'Social, Ethical and Legal Aspects of Generative AI: Tools, Techniques and Systems' Reportedly Published With Numerous Purportedly Fabricated or Unverifiable Citations
Academic researchers
Incidents Harmed By
- Incident 13081 Report
Springer Nature Book 'Mastering Machine Learning: From Basics to Advanced' Reportedly Published With Numerous Purportedly Nonexistent or Incorrect Citations
- Incident 13091 Report
Springer Nature Book 'Social, Ethical and Legal Aspects of Generative AI: Tools, Techniques and Systems' Reportedly Published With Numerous Purportedly Fabricated or Unverifiable Citations