Chatbot developers
Incidents involved as both Developer and Deployer
Incident 15351 Report
OpenAI Allegedly Failed to Intervene in ChatGPT Conversations Preceding Montreal Web Developer Alice Carrier's Suicide
2025-07-02
Kristie Carrier sued OpenAI and Sam Altman, alleging that her daughter Alice Carrier, a 24-year-old Montreal web developer who first used ChatGPT in 2023 for technical troubleshooting, later turned to the chatbot with suicidal thoughts and questions about suicide methods. The suit alleges ChatGPT mimicked a friend or therapist, criticized crisis hotlines, validated self-harm thoughts, and failed to trigger human review before Carrier died on July 2, 2025.
MoreIncidents Harmed By
Incident 13563 Report
Urban VPN Proxy Browser Extension Reportedly Harvested and Sold Private AI Chatbot Conversations via Silent Update
2025-07-09
Security researchers reported that the Urban VPN Proxy browser extension introduced AI conversation–harvesting functionality in version 5.5.0, released July 9, 2025. The extension allegedly intercepted and exfiltrated private conversations from AI platforms including ChatGPT, Claude, Gemini, Grok, and others without a user-facing opt-out. The data, including sensitive personal and financial information, was reportedly shared with affiliated data brokers for commercial analytics.
MoreIncidents involved as Developer
Incident 10611 Report
Korean Chatbot Luda Reportedly Made Offensive Remarks Towards Minority Groups in South Korea
2020-12-23
A Korean interactive chatbot was allegedly shown in screenshots to have used derogatory and bigoted language when asked about lesbians, Black people, and people with disabilities.
MoreIncident 5135 Report
ChatGPT Reportedly Banned by Italian Authority Due to OpenAI's Purported Lack of Legal Basis for Data Collection and Age Verification
2023-03-31
Italy's data protection authority is reported to have temporarily limited OpenAI's processing of Italian users' data after alleging that ChatGPT lacked adequate notice and legal basis for large-scale personal data collection and processing used to train the system. The authority also cited a March 2023 data breach, possible processing of inaccurate personal data, and the absence of age-verification safeguards for children.
MoreIncident 6365 Report
AI Romance Apps Reportedly Compromise User Privacy for Data Harvesting
2024-02-14
AI-powered romantic chatbots, marketed for enhancing mental health, are found to exploit user privacy by harvesting sensitive personal information for data sharing and targeted ads, with inadequate security measures and consent protocols, according to research by the Mozilla Foundation.
MoreIncident 12534 Report
Large-Scale Mental Health Crises Allegedly Associated with ChatGPT Interactions
2025-10-27
OpenAI disclosed internal estimates suggesting that hundreds of thousands of ChatGPT users each week exhibit signs of mania, psychosis, suicidal ideation, or emotional dependence on the chatbot. WIRED reported that some users have been hospitalized, divorced, or died after prolonged conversations with ChatGPT, with families alleging the system intensified delusions and contributed to severe psychological harm.
MoreRelated Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
Related Entities
OpenAI
Incidents involved as both Developer and Deployer
- Incident 5135 Reports
ChatGPT Reportedly Banned by Italian Authority Due to OpenAI's Purported Lack of Legal Basis for Data Collection and Age Verification
- Incident 12534 Reports
Large-Scale Mental Health Crises Allegedly Associated with ChatGPT Interactions
Incidents involved as Developer
Large language model developers
Incidents involved as both Developer and Deployer
Incidents Harmed By
Incidents involved as Developer
Replika
Incidents involved as both Developer and Deployer
- Incident 6365 Reports
AI Romance Apps Reportedly Compromise User Privacy for Data Harvesting
- Incident 4911 Report
Replika's AI Experience Reportedly Lacked Protection for Minors, Resulting in Data Ban
Incidents implicated systems
Genesia AI Friend & Partner
Incidents involved as both Developer and Deployer
Incidents implicated systems
EVA AI Chat Bot & Soulmate
Incidents involved as both Developer and Deployer
Incidents implicated systems
Lionsgate
Incidents Harmed By
- Incident 7761 Report
Megalopolis Trailer Included Fake AI-Generated Quotes Attributed to Film Critics