Chatbot developers
Incidents involved as both Developer and Deployer
Incident 15353 Report
OpenAI Allegedly Failed to Intervene in ChatGPT Conversations Preceding Montreal Web Developer Alice Carrier's Suicide
2025-07-02
Kristie Carrier sued OpenAI and Sam Altman, alleging that her daughter Alice Carrier, a 24-year-old Montreal web developer who first used ChatGPT in 2023 for technical troubleshooting, later turned to the chatbot with suicidal thoughts and questions about suicide methods. The suit alleges ChatGPT mimicked a friend or therapist, criticized crisis hotlines, validated self-harm thoughts, and failed to trigger human review before Carrier died on July 2, 2025.
MoreIncident 16093 Report
ChatGPT-4o Allegedly Discouraged Florida Pastor From Seeking Care Before Pulmonary Embolism
2025-07-13
Florida pastor Scott Winters was allegedly told by ChatGPT-4o that his worsening dizziness and pain had less serious causes, while the chatbot recommended home management and immobility and discouraged him from seeking hospital treatment. Winters was reportedly hospitalized on July 13, 2025, with a massive bilateral pulmonary embolism. The suit alleges that delayed treatment and prolonged inactivity contributed to his life-threatening condition and lasting harms.
MoreIncident 15691 Report
GPT-4o Allegedly Reinforced California Man Michael Lines's Delusions Before Suicide Attempt
2025-03-28
In March 2025, Michael Lines, a 34-year-old California man, allegedly spent weeks discussing religious delusions with GPT-4o after disclosing his bipolar disorder and medication use. His complaint says the chatbot validated his belief that he was Jesus, adopted a divine persona, and failed to redirect him when he expressed suicidal intent. Lines later overdosed and survived after law enforcement found him.
MoreIncidents Harmed By
Incident 13563 Report
Urban VPN Proxy Browser Extension Reportedly Harvested and Sold Private AI Chatbot Conversations via Silent Update
2025-07-09
Security researchers reported that the Urban VPN Proxy browser extension introduced AI conversation–harvesting functionality in version 5.5.0, released July 9, 2025. The extension allegedly intercepted and exfiltrated private conversations from AI platforms including ChatGPT, Claude, Gemini, Grok, and others without a user-facing opt-out. The data, including sensitive personal and financial information, was reportedly shared with affiliated data brokers for commercial analytics.
MoreIncidents involved as Developer
Incident 10611 Report
Korean Chatbot Luda Reportedly Made Offensive Remarks Towards Minority Groups in South Korea
2020-12-23
A Korean interactive chatbot was allegedly shown in screenshots to have used derogatory and bigoted language when asked about lesbians, Black people, and people with disabilities.
MoreIncident 4508 Report
Kenyan Data Annotators Allegedly Exposed to Graphic Content for OpenAI's AI
2021-11-01
Sama AI's Kenyan contractors were reportedly asked with excessively low pay to annotate a large volume of disturbing content to improve OpenAI's generative AI systems such as ChatGPT, and whose contract was terminated prior to completion by Sama AI.
MoreIncident 5135 Report
ChatGPT Reportedly Banned by Italian Authority Due to OpenAI's Purported Lack of Legal Basis for Data Collection and Age Verification
2023-03-31
Italy's data protection authority is reported to have temporarily limited OpenAI's processing of Italian users' data after alleging that ChatGPT lacked adequate notice and legal basis for large-scale personal data collection and processing used to train the system. The authority also cited a March 2023 data breach, possible processing of inaccurate personal data, and the absence of age-verification safeguards for children.
MoreIncident 6365 Report
AI Romance Apps Reportedly Compromise User Privacy for Data Harvesting
2024-02-14
AI-powered romantic chatbots, marketed for enhancing mental health, are found to exploit user privacy by harvesting sensitive personal information for data sharing and targeted ads, with inadequate security measures and consent protocols, according to research by the Mozilla Foundation.
MoreRelated Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
Related Entities
Chatbot users
Incidents Harmed By
- Incident 10611 Reports
Korean Chatbot Luda Reportedly Made Offensive Remarks Towards Minority Groups in South Korea
- Incident 6365 Reports
AI Romance Apps Reportedly Compromise User Privacy for Data Harvesting
Incidents involved as Deployer
OpenAI
Incidents involved as both Developer and Deployer
- Incident 4508 Reports
Kenyan Data Annotators Allegedly Exposed to Graphic Content for OpenAI's AI
- Incident 5135 Reports
ChatGPT Reportedly Banned by Italian Authority Due to OpenAI's Purported Lack of Legal Basis for Data Collection and Age Verification
Incidents Harmed By
Incidents involved as Developer
Large language model developers
Incidents involved as both Developer and Deployer
- Incident 15353 Reports
OpenAI Allegedly Failed to Intervene in ChatGPT Conversations Preceding Montreal Web Developer Alice Carrier's Suicide
- Incident 16093 Reports
ChatGPT-4o Allegedly Discouraged Florida Pastor From Seeking Care Before Pulmonary Embolism
Incidents Harmed By
Incidents involved as Developer
Minors
Incidents Harmed By
- Incident 5135 Reports
ChatGPT Reportedly Banned by Italian Authority Due to OpenAI's Purported Lack of Legal Basis for Data Collection and Age Verification
- Incident 16194 Reports
Bentonville, Arkansas, Photographer Allegedly Used Grok to Create AI-Generated Child Sexual Abuse Material from Clients' Photos
Image generation technology developers
Incidents involved as Developer
- Incident 5613 Reports
OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent
- Incident 15803 Reports
PRC-Linked Accounts Reportedly Used ChatGPT in Covert Campaigns Targeting U.S. AI Policy Debates
Incidents implicated systems
Replika
Incidents involved as both Developer and Deployer
- Incident 6365 Reports
AI Romance Apps Reportedly Compromise User Privacy for Data Harvesting
- Incident 4911 Report
Replika's AI Experience Reportedly Lacked Protection for Minors, Resulting in Data Ban
Incidents implicated systems
Genesia AI Friend & Partner
Incidents involved as both Developer and Deployer
Incidents implicated systems
EVA AI Chat Bot & Soulmate
Incidents involved as both Developer and Deployer
Incidents implicated systems
ChatGPT users
Incidents Harmed By
- Incident 12534 Reports
Large-Scale Mental Health Crises Allegedly Associated with ChatGPT Interactions
- Incident 15353 Reports
OpenAI Allegedly Failed to Intervene in ChatGPT Conversations Preceding Montreal Web Developer Alice Carrier's Suicide
Incidents involved as Deployer
Lionsgate
Incidents Harmed By
- Incident 7761 Report
Megalopolis Trailer Included Fake AI-Generated Quotes Attributed to Film Critics
Incidents involved as Deployer
OpenAI users
Incidents Harmed By
- Incident 15353 Reports
OpenAI Allegedly Failed to Intervene in ChatGPT Conversations Preceding Montreal Web Developer Alice Carrier's Suicide
- Incident 16363 Reports
Purportedly AI-Generated Travel Information Reportedly Misled Tourists into Seeking Nonexistent 'Sacred Canyon of Humantay' in Peru
Incidents involved as Deployer
Synthetic media generation technology developers
Incidents involved as Developer
- Incident 16194 Reports
Bentonville, Arkansas, Photographer Allegedly Used Grok to Create AI-Generated Child Sexual Abuse Material from Clients' Photos
- Incident 15803 Reports
PRC-Linked Accounts Reportedly Used ChatGPT in Covert Campaigns Targeting U.S. AI Policy Debates
Incidents implicated systems
Travelers
Incidents Harmed By
- Incident 16353 Reports
ChatGPT Reportedly Gave Incorrect Mount Misen Ropeway Hours, Leaving Couple Stranded After Hike in Japan
- Incident 16363 Reports
Purportedly AI-Generated Travel Information Reportedly Misled Tourists into Seeking Nonexistent 'Sacred Canyon of Humantay' in Peru
Incidents involved as Deployer
tourists
Incidents Harmed By
- Incident 16353 Reports
ChatGPT Reportedly Gave Incorrect Mount Misen Ropeway Hours, Leaving Couple Stranded After Hike in Japan
- Incident 16363 Reports
Purportedly AI-Generated Travel Information Reportedly Misled Tourists into Seeking Nonexistent 'Sacred Canyon of Humantay' in Peru