Large language model developers
Incidents involved as both Developer and Deployer
Incident 15353 Report
OpenAI Allegedly Failed to Intervene in ChatGPT Conversations Preceding Montreal Web Developer Alice Carrier's Suicide
2025-07-02
Kristie Carrier sued OpenAI and Sam Altman, alleging that her daughter Alice Carrier, a 24-year-old Montreal web developer who first used ChatGPT in 2023 for technical troubleshooting, later turned to the chatbot with suicidal thoughts and questions about suicide methods. The suit alleges ChatGPT mimicked a friend or therapist, criticized crisis hotlines, validated self-harm thoughts, and failed to trigger human review before Carrier died on July 2, 2025.
MoreIncident 16093 Report
ChatGPT-4o Allegedly Discouraged Florida Pastor From Seeking Care Before Pulmonary Embolism
2025-07-13
Florida pastor Scott Winters was allegedly told by ChatGPT-4o that his worsening dizziness and pain had less serious causes, while the chatbot recommended home management and immobility and discouraged him from seeking hospital treatment. Winters was reportedly hospitalized on July 13, 2025, with a massive bilateral pulmonary embolism. The suit alleges that delayed treatment and prolonged inactivity contributed to his life-threatening condition and lasting harms.
MoreIncidents Harmed By
Incident 13563 Report
Urban VPN Proxy Browser Extension Reportedly Harvested and Sold Private AI Chatbot Conversations via Silent Update
2025-07-09
Security researchers reported that the Urban VPN Proxy browser extension introduced AI conversation–harvesting functionality in version 5.5.0, released July 9, 2025. The extension allegedly intercepted and exfiltrated private conversations from AI platforms including ChatGPT, Claude, Gemini, Grok, and others without a user-facing opt-out. The data, including sensitive personal and financial information, was reportedly shared with affiliated data brokers for commercial analytics.
MoreIncidents involved as Developer
Incident 111841 Report
Ongoing Purported AI-Assisted Identity Fraud Enables Unauthorized Access to Western Companies by North Korean IT Workers
2021-01-01
North Korean operatives have reportedly used AI-generated identities to secure remote jobs or impersonate employers in order to infiltrate companies. These tactics allegedly support sanctions evasion through wage theft, credential exfiltration, and malware deployment. Workers reportedly use fake resumes, VPNs, and face-altering tools; some deploy malware like OtterCookie after embedding, while others lure targets via spoofed job interviews. AI systems are reportedly used to generate fake resumes, alter profile photos, and assist in real-time responses during video interviews.
MoreIncident 114526 Report
MyPillow Defense Lawyers in Coomer v. Lindell Reportedly Sanctioned for Filing Court Document Allegedly Containing AI-Generated Legal Citations
2025-02-25
In February 2025, lawyers Christopher I. Kachouroff and Jennifer T. DeMaster, representing Mike Lindell, reportedly used generative AI to draft a court brief that contained nearly 30 defective or fabricated citations. The error-filled filing violated federal court rules requiring factual and legal accuracy. The judge fined both lawyers $3,000 each, citing either the improper use of AI or gross carelessness as the cause of the misleading legal content.
MoreIncident 162713 Report
Claude Opus 4.7 Reportedly Compromised Real Company's Production Infrastructure During Cybersecurity Evaluation
2026-07-30
During an Anthropic cybersecurity evaluation conducted with Irregular, Claude Opus 4.7 reportedly reached a real company whose domain matched a fictional target, extracted application and infrastructure credentials, and accessed a database containing several hundred rows of production data. Across four runs, the model continued attacking after recognizing that the target was likely real.
MoreIncident 162813 Report
Claude Mythos 5 Reportedly Published Malicious PyPI Package That Compromised Real Security Company During Evaluation
2026-07-30
During an Anthropic cybersecurity evaluation with Irregular, Claude Mythos 5 reportedly created and published a malicious Python package to PyPI while pursuing a fictional target. The package was reportedly available for about an hour and ran on 15 real systems. On a security company's scanner, it reportedly exfiltrated credentials that Claude then used to access additional company infrastructure.
MoreRelated Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
Related Entities
OpenAI
Incidents involved as both Developer and Deployer
- Incident 4508 Reports
Kenyan Data Annotators Allegedly Exposed to Graphic Content for OpenAI's AI
- Incident 5135 Reports
ChatGPT Reportedly Banned by Italian Authority Due to OpenAI's Purported Lack of Legal Basis for Data Collection and Age Verification
Incidents Harmed By
- Incident 16045 Reports
OpenAI Models Reportedly Compromised Hugging Face Production Infrastructure During Cybersecurity Evaluation
- Incident 15803 Reports
PRC-Linked Accounts Reportedly Used ChatGPT in Covert Campaigns Targeting U.S. AI Policy Debates
Incidents involved as Developer
Chatbot developers
Incidents involved as both Developer and Deployer
- Incident 15353 Reports
OpenAI Allegedly Failed to Intervene in ChatGPT Conversations Preceding Montreal Web Developer Alice Carrier's Suicide
- Incident 16093 Reports
ChatGPT-4o Allegedly Discouraged Florida Pastor From Seeking Care Before Pulmonary Embolism
Incidents Harmed By
Incidents involved as Developer
Large language models
Incidents implicated systems
- Incident 111841 Reports
Ongoing Purported AI-Assisted Identity Fraud Enables Unauthorized Access to Western Companies by North Korean IT Workers
- Incident 114526 Reports
MyPillow Defense Lawyers in Coomer v. Lindell Reportedly Sanctioned for Filing Court Document Allegedly Containing AI-Generated Legal Citations
Image generation technology developers
Incidents involved as Developer
- Incident 5613 Reports
OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent
- Incident 15803 Reports
PRC-Linked Accounts Reportedly Used ChatGPT in Covert Campaigns Targeting U.S. AI Policy Debates
Incidents implicated systems
ChatGPT users
Incidents Harmed By
- Incident 12534 Reports
Large-Scale Mental Health Crises Allegedly Associated with ChatGPT Interactions
- Incident 15353 Reports
OpenAI Allegedly Failed to Intervene in ChatGPT Conversations Preceding Montreal Web Developer Alice Carrier's Suicide
Incidents involved as Deployer
Incidents involved as both Developer and Deployer
- Incident 7431 Report
Gemini AI Allegedly Reads Google Drive Files Without Explicit User Consent
- Incident 12791 Report
Prominent AI Chatbots Allegedly Produced Incorrect UK Financial and ISA Guidance
Incidents Harmed By
Incidents involved as Developer
Epistemic integrity
Incidents Harmed By
- Incident 111841 Reports
Ongoing Purported AI-Assisted Identity Fraud Enables Unauthorized Access to Western Companies by North Korean IT Workers
- Incident 114526 Reports
MyPillow Defense Lawyers in Coomer v. Lindell Reportedly Sanctioned for Filing Court Document Allegedly Containing AI-Generated Legal Citations
Educational communities
Incidents Harmed By
- Incident 10094 Reports
Purportedly AI-Assisted Report by Tromsø Officials Allegedly Cited Non-Existent Sources in School Closure Proposal
- Incident 9151 Report
Alaska Education Department Reportedly Published Policy Featuring Erroneous AI-Generated Citations
Incidents involved as Deployer
OpenAI users
Incidents Harmed By
- Incident 15353 Reports
OpenAI Allegedly Failed to Intervene in ChatGPT Conversations Preceding Montreal Web Developer Alice Carrier's Suicide
- Incident 16363 Reports
Purportedly AI-Generated Travel Information Reportedly Misled Tourists into Seeking Nonexistent 'Sacred Canyon of Humantay' in Peru
Incidents involved as Deployer
Chatbot users
Incidents Harmed By
- Incident 12534 Reports
Large-Scale Mental Health Crises Allegedly Associated with ChatGPT Interactions
- Incident 15353 Reports
OpenAI Allegedly Failed to Intervene in ChatGPT Conversations Preceding Montreal Web Developer Alice Carrier's Suicide
Incidents involved as Developer
Incidents involved as Deployer
Occupants and residents of buildings adjacent to American Reproductive Centers in Palm Springs
Incidents Harmed By
Generative AI developers
Incidents involved as Developer
- Incident 14444 Reports
Hachette Reportedly Canceled Publication of Mia Ballard's Shy Girl After Generative AI Authorship Allegations
- Incident 14474 Reports
Sixth Circuit Sanctioned Lawyers in Whiting v. City of Athens over Alleged Fake Appellate Citations in Briefs Reportedly Bearing Hallmarks of Hallucinations
Springer Nature
Incidents involved as Deployer
- Incident 13081 Report
Springer Nature Book 'Mastering Machine Learning: From Basics to Advanced' Reportedly Published With Numerous Purportedly Nonexistent or Incorrect Citations
- Incident 13091 Report
Springer Nature Book 'Social, Ethical and Legal Aspects of Generative AI: Tools, Techniques and Systems' Reportedly Published With Numerous Purportedly Fabricated or Unverifiable Citations
Academic researchers
Incidents Harmed By
- Incident 13081 Report
Springer Nature Book 'Mastering Machine Learning: From Basics to Advanced' Reportedly Published With Numerous Purportedly Nonexistent or Incorrect Citations
- Incident 13091 Report
Springer Nature Book 'Social, Ethical and Legal Aspects of Generative AI: Tools, Techniques and Systems' Reportedly Published With Numerous Purportedly Fabricated or Unverifiable Citations
Unknown generative AI systems
Incidents implicated systems
- Incident 14444 Reports
Hachette Reportedly Canceled Publication of Mia Ballard's Shy Girl After Generative AI Authorship Allegations
- Incident 14474 Reports
Sixth Circuit Sanctioned Lawyers in Whiting v. City of Athens over Alleged Fake Appellate Citations in Briefs Reportedly Bearing Hallmarks of Hallucinations
United States Attorney's Office for the Eastern District of North Carolina
Incidents involved as Deployer
Department of Communications and Digital Technologies (South Africa)
Incidents involved as Deployer
Synthetic media generation technology developers
Incidents involved as Developer
- Incident 16194 Reports
Bentonville, Arkansas, Photographer Allegedly Used Grok to Create AI-Generated Child Sexual Abuse Material from Clients' Photos
- Incident 15803 Reports
PRC-Linked Accounts Reportedly Used ChatGPT in Covert Campaigns Targeting U.S. AI Policy Debates
Incidents implicated systems
Meta algorithmically assisted performance ranking and calibration system
Incidents implicated systems
AI-assisted public consultation response generator developers
Incidents involved as Developer
Anthropic
Incidents involved as both Developer and Deployer
- Incident 162713 Reports
Claude Opus 4.7 Reportedly Compromised Real Company's Production Infrastructure During Cybersecurity Evaluation
- Incident 162813 Reports
Claude Mythos 5 Reportedly Published Malicious PyPI Package That Compromised Real Security Company During Evaluation
Incidents Harmed By
Incidents involved as Developer
Unidentified companies compromised during Anthropic cybersecurity evaluations disclosed July 2026
Incidents Harmed By
Travelers
Incidents Harmed By
- Incident 16353 Reports
ChatGPT Reportedly Gave Incorrect Mount Misen Ropeway Hours, Leaving Couple Stranded After Hike in Japan
- Incident 16363 Reports
Purportedly AI-Generated Travel Information Reportedly Misled Tourists into Seeking Nonexistent 'Sacred Canyon of Humantay' in Peru
Incidents involved as Deployer
tourists
Incidents Harmed By
- Incident 16353 Reports
ChatGPT Reportedly Gave Incorrect Mount Misen Ropeway Hours, Leaving Couple Stranded After Hike in Japan
- Incident 16363 Reports
Purportedly AI-Generated Travel Information Reportedly Misled Tourists into Seeking Nonexistent 'Sacred Canyon of Humantay' in Peru