Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Donate
Discover
Submit
  • Welcome to the AIID
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Spatial View
  • Blog
  • AI News Digest
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Spatial View
  • Blog
  • AI News Digest
  • Random Incident
  • Sign Up
Collapse
Entities

OpenAI users

Incidents Harmed By

Incident 11064 Report
Chatbots Allegedly Reinforced Delusional Thinking in Several Reported Users, Leading to Real-World Harm

2025-06-13

Multiple reports from March to June 2025 describe cases in which chatbots allegedly reinforced delusional beliefs, conspiracies, and dangerous behavior. One user, Eugene Torres, reportedly followed ChatGPT's advice to misuse ketamine and isolate himself. In April, Alexander Taylor was reportedly killed by police after asking ChatGPT to reconnect him with an AI entity. Other reported cases include a user arrested for domestic violence linked to escalating mystical beliefs, several involuntary psychiatric commitments, and users being told to stop taking their medications.

More

Incident 13703 Report
California Teen Reportedly Died of Overdose After Repeatedly Seeking Drug-Use Guidance Allegedly from ChatGPT

2025-05-31

In San Jose, California, 19-year-old Sam Nelson reportedly died from an overdose. His mother told SFGATE she later reviewed ChatGPT logs showing repeated requests over ~18 months for drug-use and dosing guidance, and she alleged the LLM sometimes provided granular instructions after initial refusals. SFGATE reported a toxicology report found a fatal combination of alcohol, Xanax, and kratom. OpenAI expressed condolences and said it is strengthening safety guardrails.

More

Incident 15353 Report
OpenAI Allegedly Failed to Intervene in ChatGPT Conversations Preceding Montreal Web Developer Alice Carrier's Suicide

2025-07-02

Kristie Carrier sued OpenAI and Sam Altman, alleging that her daughter Alice Carrier, a 24-year-old Montreal web developer who first used ChatGPT in 2023 for technical troubleshooting, later turned to the chatbot with suicidal thoughts and questions about suicide methods. The suit alleges ChatGPT mimicked a friend or therapist, criticized crisis hotlines, validated self-harm thoughts, and failed to trigger human review before Carrier died on July 2, 2025.

More

Incident 12812 Report
Alleged Harmful Health Outcomes Following Reported Use of Purported ChatGPT-Generated Medical Advice in Hyderabad

2025-11-10

Reports from Hyderabad describe two alleged patient harms after individuals acted on purportedly ChatGPT-generated medical advice instead of clinician guidance. A kidney-transplant recipient reportedly discontinued prescribed post-transplant medications based on a chatbot suggestion and experienced graft failure. In a separate case, a man with diabetes allegedly developed severe hyponatremia after following a chatbot-advised zero-salt diet.

More

Incidents involved as Deployer

Incident 15803 Report
PRC-Linked Accounts Reportedly Used ChatGPT in Covert Campaigns Targeting U.S. AI Policy Debates

2026-06-10

OpenAI reported that two clusters of ChatGPT accounts likely originating from China used its models to support apparent covert influence operations about U.S. AI and technology policy. The accounts reportedly generated a variety of media and social media comments about AI data centers, electricity costs, tariffs, and U.S. tech competition before OpenAI banned them.

More

Related Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
 

Entity

OpenAI

Incidents involved as both Developer and Deployer
  • Incident 1106
    4 Reports

    Chatbots Allegedly Reinforced Delusional Thinking in Several Reported Users, Leading to Real-World Harm

  • Incident 1370
    3 Reports

    California Teen Reportedly Died of Overdose After Repeatedly Seeking Drug-Use Guidance Allegedly from ChatGPT

Incidents Harmed By
  • Incident 1580
    3 Reports

    PRC-Linked Accounts Reportedly Used ChatGPT in Covert Campaigns Targeting U.S. AI Policy Debates

  • Incident 729
    1 Report

    GPT-4o's Chinese Tokens Reportedly Compromised by Spam and Pornography Due to Inadequate Filtering

Incidents involved as Developer
  • Incident 1580
    3 Reports

    PRC-Linked Accounts Reportedly Used ChatGPT in Covert Campaigns Targeting U.S. AI Policy Debates

  • Incident 948
    1 Report

    Alleged FraudGPT-Enabled Phishing Attack Spoofs ChatGPT Subscription Service to Steal Credentials

More
Entity

GPT-4o

Incidents involved as Deployer
  • Incident 729
    1 Report

    GPT-4o's Chinese Tokens Reportedly Compromised by Spam and Pornography Due to Inadequate Filtering

Incidents implicated systems
  • Incident 1106
    4 Reports

    Chatbots Allegedly Reinforced Delusional Thinking in Several Reported Users, Leading to Real-World Harm

  • Incident 1569
    1 Report

    GPT-4o Allegedly Reinforced California Man Michael Lines's Delusions Before Suicide Attempt

More
Entity

Researchers

Incidents Harmed By
  • Incident 729
    1 Report

    GPT-4o's Chinese Tokens Reportedly Compromised by Spam and Pornography Due to Inadequate Filtering

More
Entity

ChatGPT

Incidents Harmed By
  • Incident 729
    1 Report

    GPT-4o's Chinese Tokens Reportedly Compromised by Spam and Pornography Due to Inadequate Filtering

  • Incident 948
    1 Report

    Alleged FraudGPT-Enabled Phishing Attack Spoofs ChatGPT Subscription Service to Steal Credentials

Incidents implicated systems
  • Incident 1106
    4 Reports

    Chatbots Allegedly Reinforced Delusional Thinking in Several Reported Users, Leading to Real-World Harm

  • Incident 1370
    3 Reports

    California Teen Reportedly Died of Overdose After Repeatedly Seeking Drug-Use Guidance Allegedly from ChatGPT

More
Entity

Cybercriminals

Incidents involved as Deployer
  • Incident 948
    1 Report

    Alleged FraudGPT-Enabled Phishing Attack Spoofs ChatGPT Subscription Service to Steal Credentials

More
Entity

Phishing scammers

Incidents involved as Deployer
  • Incident 948
    1 Report

    Alleged FraudGPT-Enabled Phishing Attack Spoofs ChatGPT Subscription Service to Steal Credentials

More
Entity

FraudGPT operators

Incidents involved as Deployer
  • Incident 948
    1 Report

    Alleged FraudGPT-Enabled Phishing Attack Spoofs ChatGPT Subscription Service to Steal Credentials

More
Entity

Dark Web threat actors

Incidents involved as Deployer
  • Incident 948
    1 Report

    Alleged FraudGPT-Enabled Phishing Attack Spoofs ChatGPT Subscription Service to Steal Credentials

More
Entity

Scammers

Incidents involved as Deployer
  • Incident 948
    1 Report

    Alleged FraudGPT-Enabled Phishing Attack Spoofs ChatGPT Subscription Service to Steal Credentials

More
Entity

FraudGPT

Incidents involved as Developer
  • Incident 948
    1 Report

    Alleged FraudGPT-Enabled Phishing Attack Spoofs ChatGPT Subscription Service to Steal Credentials

Incidents implicated systems
  • Incident 948
    1 Report

    Alleged FraudGPT-Enabled Phishing Attack Spoofs ChatGPT Subscription Service to Steal Credentials

More
Entity

Large language model developers

Incidents involved as both Developer and Deployer
  • Incident 1535
    3 Reports

    OpenAI Allegedly Failed to Intervene in ChatGPT Conversations Preceding Montreal Web Developer Alice Carrier's Suicide

Incidents involved as Developer
  • Incident 1580
    3 Reports

    PRC-Linked Accounts Reportedly Used ChatGPT in Covert Campaigns Targeting U.S. AI Policy Debates

  • Incident 1031
    1 Report

    Transgender User Alleges ChatGPT Allowed Suicide Letter Without Crisis Intervention

More
Entity

Chatbot developers

Incidents involved as both Developer and Deployer
  • Incident 1535
    3 Reports

    OpenAI Allegedly Failed to Intervene in ChatGPT Conversations Preceding Montreal Web Developer Alice Carrier's Suicide

  • Incident 1569
    1 Report

    GPT-4o Allegedly Reinforced California Man Michael Lines's Delusions Before Suicide Attempt

Incidents involved as Developer
  • Incident 1580
    3 Reports

    PRC-Linked Accounts Reportedly Used ChatGPT in Covert Campaigns Targeting U.S. AI Policy Debates

  • Incident 1031
    1 Report

    Transgender User Alleges ChatGPT Allowed Suicide Letter Without Crisis Intervention

More
Entity

Miranda Jane Ellison

Incidents Harmed By
  • Incident 1031
    1 Report

    Transgender User Alleges ChatGPT Allowed Suicide Letter Without Crisis Intervention

More
Entity

ChatGPT users experiencing suicidal ideation

Incidents Harmed By
  • Incident 1535
    3 Reports

    OpenAI Allegedly Failed to Intervene in ChatGPT Conversations Preceding Montreal Web Developer Alice Carrier's Suicide

  • Incident 1031
    1 Report

    Transgender User Alleges ChatGPT Allowed Suicide Letter Without Crisis Intervention

More
Entity

ChatGPT users

Incidents Harmed By
  • Incident 1106
    4 Reports

    Chatbots Allegedly Reinforced Delusional Thinking in Several Reported Users, Leading to Real-World Harm

  • Incident 1370
    3 Reports

    California Teen Reportedly Died of Overdose After Repeatedly Seeking Drug-Use Guidance Allegedly from ChatGPT

Incidents involved as Deployer
  • Incident 1580
    3 Reports

    PRC-Linked Accounts Reportedly Used ChatGPT in Covert Campaigns Targeting U.S. AI Policy Debates

More
Entity

Chatbot users experiencing suicidal ideation

Incidents Harmed By
  • Incident 1031
    1 Report

    Transgender User Alleges ChatGPT Allowed Suicide Letter Without Crisis Intervention

  • Incident 1569
    1 Report

    GPT-4o Allegedly Reinforced California Man Michael Lines's Delusions Before Suicide Attempt

More
Entity

Chatbot users

Incidents Harmed By
  • Incident 1535
    3 Reports

    OpenAI Allegedly Failed to Intervene in ChatGPT Conversations Preceding Montreal Web Developer Alice Carrier's Suicide

  • Incident 1031
    1 Report

    Transgender User Alleges ChatGPT Allowed Suicide Letter Without Crisis Intervention

More
Entity

Emotionally vulnerable individuals

Incidents Harmed By
  • Incident 1031
    1 Report

    Transgender User Alleges ChatGPT Allowed Suicide Letter Without Crisis Intervention

  • Incident 1569
    1 Report

    GPT-4o Allegedly Reinforced California Man Michael Lines's Delusions Before Suicide Attempt

More
Entity

Vulnerable chatbot users

Incidents Harmed By
  • Incident 1031
    1 Report

    Transgender User Alleges ChatGPT Allowed Suicide Letter Without Crisis Intervention

More
Entity

Large language models

Incidents implicated systems
  • Incident 1535
    3 Reports

    OpenAI Allegedly Failed to Intervene in ChatGPT Conversations Preceding Montreal Web Developer Alice Carrier's Suicide

  • Incident 1580
    3 Reports

    PRC-Linked Accounts Reportedly Used ChatGPT in Covert Campaigns Targeting U.S. AI Policy Debates

More
Entity

GPT-4

Incidents implicated systems
  • Incident 1106
    4 Reports

    Chatbots Allegedly Reinforced Delusional Thinking in Several Reported Users, Leading to Real-World Harm

  • Incident 1031
    1 Report

    Transgender User Alleges ChatGPT Allowed Suicide Letter Without Crisis Intervention

More
Entity

Chatbots

Incidents implicated systems
  • Incident 1535
    3 Reports

    OpenAI Allegedly Failed to Intervene in ChatGPT Conversations Preceding Montreal Web Developer Alice Carrier's Suicide

  • Incident 1580
    3 Reports

    PRC-Linked Accounts Reportedly Used ChatGPT in Covert Campaigns Targeting U.S. AI Policy Debates

More
Entity

Microsoft

Incidents involved as both Developer and Deployer
  • Incident 1106
    4 Reports

    Chatbots Allegedly Reinforced Delusional Thinking in Several Reported Users, Leading to Real-World Harm

More
Entity

Unnamed Copilot users

Incidents Harmed By
  • Incident 1106
    4 Reports

    Chatbots Allegedly Reinforced Delusional Thinking in Several Reported Users, Leading to Real-World Harm

More
Entity

Eugene Torres

Incidents Harmed By
  • Incident 1106
    4 Reports

    Chatbots Allegedly Reinforced Delusional Thinking in Several Reported Users, Leading to Real-World Harm

More
Entity

Andrew (surname withheld)

Incidents Harmed By
  • Incident 1106
    4 Reports

    Chatbots Allegedly Reinforced Delusional Thinking in Several Reported Users, Leading to Real-World Harm

More
Entity

Allyson (surname withheld)

Incidents Harmed By
  • Incident 1106
    4 Reports

    Chatbots Allegedly Reinforced Delusional Thinking in Several Reported Users, Leading to Real-World Harm

More
Entity

Alexander Taylor

Incidents Harmed By
  • Incident 1106
    4 Reports

    Chatbots Allegedly Reinforced Delusional Thinking in Several Reported Users, Leading to Real-World Harm

More
Entity

Copilot

Incidents implicated systems
  • Incident 1106
    4 Reports

    Chatbots Allegedly Reinforced Delusional Thinking in Several Reported Users, Leading to Real-World Harm

More
Entity

Therapy chatbots

Incidents implicated systems
  • Incident 1106
    4 Reports

    Chatbots Allegedly Reinforced Delusional Thinking in Several Reported Users, Leading to Real-World Harm

More
Entity

Unnamed patient with diabetes in Hyderabad

Incidents Harmed By
  • Incident 1281
    2 Reports

    Alleged Harmful Health Outcomes Following Reported Use of Purported ChatGPT-Generated Medical Advice in Hyderabad

More
Entity

Unnamed kidney transplant patient in Hyderabad

Incidents Harmed By
  • Incident 1281
    2 Reports

    Alleged Harmful Health Outcomes Following Reported Use of Purported ChatGPT-Generated Medical Advice in Hyderabad

More
Entity

General public of India

Incidents Harmed By
  • Incident 1281
    2 Reports

    Alleged Harmful Health Outcomes Following Reported Use of Purported ChatGPT-Generated Medical Advice in Hyderabad

More
Entity

General public of Hyderabad

Incidents Harmed By
  • Incident 1281
    2 Reports

    Alleged Harmful Health Outcomes Following Reported Use of Purported ChatGPT-Generated Medical Advice in Hyderabad

More
Entity

General public

Incidents Harmed By
  • Incident 1580
    3 Reports

    PRC-Linked Accounts Reportedly Used ChatGPT in Covert Campaigns Targeting U.S. AI Policy Debates

  • Incident 1281
    2 Reports

    Alleged Harmful Health Outcomes Following Reported Use of Purported ChatGPT-Generated Medical Advice in Hyderabad

More
Entity

Sam Nelson

Incidents Harmed By
  • Incident 1370
    3 Reports

    California Teen Reportedly Died of Overdose After Repeatedly Seeking Drug-Use Guidance Allegedly from ChatGPT

More
Entity

Family of Sam Nelson

Incidents Harmed By
  • Incident 1370
    3 Reports

    California Teen Reportedly Died of Overdose After Repeatedly Seeking Drug-Use Guidance Allegedly from ChatGPT

More
Entity

Kristie Carrier

Incidents Harmed By
  • Incident 1535
    3 Reports

    OpenAI Allegedly Failed to Intervene in ChatGPT Conversations Preceding Montreal Web Developer Alice Carrier's Suicide

More
Entity

Alice Carrier

Incidents Harmed By
  • Incident 1535
    3 Reports

    OpenAI Allegedly Failed to Intervene in ChatGPT Conversations Preceding Montreal Web Developer Alice Carrier's Suicide

More
Entity

Michael Lines

Incidents Harmed By
  • Incident 1569
    1 Report

    GPT-4o Allegedly Reinforced California Man Michael Lines's Delusions Before Suicide Attempt

More
Entity

People with bipolar disorder

Incidents Harmed By
  • Incident 1569
    1 Report

    GPT-4o Allegedly Reinforced California Man Michael Lines's Delusions Before Suicide Attempt

More
Entity

OpenAI large language models

Incidents implicated systems
  • Incident 1569
    1 Report

    GPT-4o Allegedly Reinforced California Man Michael Lines's Delusions Before Suicide Attempt

More
Entity

People's Republic of China-linked influence operators

Incidents involved as Deployer
  • Incident 1580
    3 Reports

    PRC-Linked Accounts Reportedly Used ChatGPT in Covert Campaigns Targeting U.S. AI Policy Debates

More
Entity

Information manipulation actors in China

Incidents involved as Deployer
  • Incident 1580
    3 Reports

    PRC-Linked Accounts Reportedly Used ChatGPT in Covert Campaigns Targeting U.S. AI Policy Debates

More
Entity

Information manipulation actors

Incidents involved as Deployer
  • Incident 1580
    3 Reports

    PRC-Linked Accounts Reportedly Used ChatGPT in Covert Campaigns Targeting U.S. AI Policy Debates

More
Entity

Synthetic media generation technology developers

Incidents involved as Developer
  • Incident 1580
    3 Reports

    PRC-Linked Accounts Reportedly Used ChatGPT in Covert Campaigns Targeting U.S. AI Policy Debates

More
Entity

Image generation technology developers

Incidents involved as Developer
  • Incident 1580
    3 Reports

    PRC-Linked Accounts Reportedly Used ChatGPT in Covert Campaigns Targeting U.S. AI Policy Debates

More
Entity

Social media users

Incidents Harmed By
  • Incident 1580
    3 Reports

    PRC-Linked Accounts Reportedly Used ChatGPT in Covert Campaigns Targeting U.S. AI Policy Debates

More
Entity

People participating in U.S. AI policy debates

Incidents Harmed By
  • Incident 1580
    3 Reports

    PRC-Linked Accounts Reportedly Used ChatGPT in Covert Campaigns Targeting U.S. AI Policy Debates

More
Entity

National security and intelligence stakeholders

Incidents Harmed By
  • Incident 1580
    3 Reports

    PRC-Linked Accounts Reportedly Used ChatGPT in Covert Campaigns Targeting U.S. AI Policy Debates

More
Entity

General public of the United Statese

Incidents Harmed By
  • Incident 1580
    3 Reports

    PRC-Linked Accounts Reportedly Used ChatGPT in Covert Campaigns Targeting U.S. AI Policy Debates

More
Entity

Epistemic integrity

Incidents Harmed By
  • Incident 1580
    3 Reports

    PRC-Linked Accounts Reportedly Used ChatGPT in Covert Campaigns Targeting U.S. AI Policy Debates

More
Entity

Communities debating AI data center development

Incidents Harmed By
  • Incident 1580
    3 Reports

    PRC-Linked Accounts Reportedly Used ChatGPT in Covert Campaigns Targeting U.S. AI Policy Debates

More
Entity

X (Twitter)

Incidents implicated systems
  • Incident 1580
    3 Reports

    PRC-Linked Accounts Reportedly Used ChatGPT in Covert Campaigns Targeting U.S. AI Policy Debates

More
Entity

Synthetic media generation technology

Incidents implicated systems
  • Incident 1580
    3 Reports

    PRC-Linked Accounts Reportedly Used ChatGPT in Covert Campaigns Targeting U.S. AI Policy Debates

More
Entity

Social media platforms

Incidents implicated systems
  • Incident 1580
    3 Reports

    PRC-Linked Accounts Reportedly Used ChatGPT in Covert Campaigns Targeting U.S. AI Policy Debates

More
Entity

Image generation technology

Incidents implicated systems
  • Incident 1580
    3 Reports

    PRC-Linked Accounts Reportedly Used ChatGPT in Covert Campaigns Targeting U.S. AI Policy Debates

More

Entity Relationships
To what other entities this entity has a direct relationship. For example, 'Amazon' and 'Amazon Workers' could be linked entities.
 

Entity

ChatGPT users

More

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2026 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • 18fcd27