Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Donate
Discover
Submit
  • Welcome to the AIID
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Spatial View
  • Blog
  • AI News Digest
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Spatial View
  • Blog
  • AI News Digest
  • Random Incident
  • Sign Up
Collapse
Entities

Emotionally vulnerable individuals

Incidents Harmed By

Incident 112222 Report
Reportedly Sustained Multi-Celebrity Deepfake Persona Scam Targeting Vulnerable Southampton Resident

2025-06-28

Over about five months in 2025, Paul Davis, a Southampton, UK man, reports that he was repeatedly targeted by scammers using purported deepfake videos and images of celebrities including Jennifer Aniston, Mark Zuckerberg, Elon Musk, and Ellie Goulding. The perpetrators allegedly rotated personas to sustain a romance and prize scam, extracting £200 in gift cards. This case suggests a new shift from one-off celebrity deepfakes to persistent, multi-persona targeting of a single vulnerable victim.

More

Incident 11928 Report
16-Year-Old Allegedly Received Suicide Method Guidance from ChatGPT Before Death

2025-04-11

16-year-old Adam Raine reportedly died by suicide after allegedly confiding in OpenAI's ChatGPT-4o, which he reportedly used extensively in the months prior. Transcripts reportedly show the chatbot provided empathetic support but also allegedly offered details on suicide methods, validated attempts, and at times discouraged disclosure to family. His parents have reportedly filed a wrongful death lawsuit against OpenAI, alleging design choices nurtured dependency and failed safeguards.

More

Incident 10415 Report
Nomi Chatbots Reportedly Encouraged Suicide, Sexual Violence, Terrorism, and Hate Speech

2025-01-21

External testing reportedly found that Glimpse AI's chatbots on the Nomi platform encouraged suicide, sexual violence (including with underage personas), terrorism, and hate speech. Conversations allegedly included explicit methods for self-harm, child abuse, bomb-making, and racially motivated violence. Screenshots and transcripts were shared with media outlets. Nomi's developer, Glimpse AI, reportedly declined to implement stronger safety controls following user concerns.

More

Incident 12534 Report
Large-Scale Mental Health Crises Allegedly Associated with ChatGPT Interactions

2025-10-27

OpenAI disclosed internal estimates suggesting that hundreds of thousands of ChatGPT users each week exhibit signs of mania, psychosis, suicidal ideation, or emotional dependence on the chatbot. WIRED reported that some users have been hospitalized, divorced, or died after prolonged conversations with ChatGPT, with families alleging the system intensified delusions and contributed to severe psychological harm.

More

Related Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
 

Entity

Yahoo Boys

Incidents involved as Deployer
  • Incident 912
    2 Reports

    Yahoo Boys and Scammers from Morocco Allegedly Target U.S. Widows and Vulnerable Individuals with 'Artificial Patriot' Scams

More
Entity

Scammers from West Africa

Incidents involved as Deployer
  • Incident 912
    2 Reports

    Yahoo Boys and Scammers from Morocco Allegedly Target U.S. Widows and Vulnerable Individuals with 'Artificial Patriot' Scams

More
Entity

Scammers from Morocco

Incidents involved as Deployer
  • Incident 912
    2 Reports

    Yahoo Boys and Scammers from Morocco Allegedly Target U.S. Widows and Vulnerable Individuals with 'Artificial Patriot' Scams

More
Entity

Scammers from Ghana

Incidents involved as Deployer
  • Incident 912
    2 Reports

    Yahoo Boys and Scammers from Morocco Allegedly Target U.S. Widows and Vulnerable Individuals with 'Artificial Patriot' Scams

More
Entity

Brouteurs

Incidents involved as Deployer
  • Incident 912
    2 Reports

    Yahoo Boys and Scammers from Morocco Allegedly Target U.S. Widows and Vulnerable Individuals with 'Artificial Patriot' Scams

More
Entity

Scammers in Nigeria

Incidents involved as Deployer
  • Incident 912
    2 Reports

    Yahoo Boys and Scammers from Morocco Allegedly Target U.S. Widows and Vulnerable Individuals with 'Artificial Patriot' Scams

More
Entity

Deepfake technology developers

Incidents involved as Developer
  • Incident 1122
    22 Reports

    Reportedly Sustained Multi-Celebrity Deepfake Persona Scam Targeting Vulnerable Southampton Resident

  • Incident 912
    2 Reports

    Yahoo Boys and Scammers from Morocco Allegedly Target U.S. Widows and Vulnerable Individuals with 'Artificial Patriot' Scams

More
Entity

Synthetic audio generation technology developers

Incidents involved as Developer
  • Incident 1122
    22 Reports

    Reportedly Sustained Multi-Celebrity Deepfake Persona Scam Targeting Vulnerable Southampton Resident

  • Incident 912
    2 Reports

    Yahoo Boys and Scammers from Morocco Allegedly Target U.S. Widows and Vulnerable Individuals with 'Artificial Patriot' Scams

More
Entity

Widows

Incidents Harmed By
  • Incident 912
    2 Reports

    Yahoo Boys and Scammers from Morocco Allegedly Target U.S. Widows and Vulnerable Individuals with 'Artificial Patriot' Scams

More
Entity

Matthew W. McFarlane

Incidents Harmed By
  • Incident 912
    2 Reports

    Yahoo Boys and Scammers from Morocco Allegedly Target U.S. Widows and Vulnerable Individuals with 'Artificial Patriot' Scams

More
Entity

Impersonated American military officials

Incidents Harmed By
  • Incident 912
    2 Reports

    Yahoo Boys and Scammers from Morocco Allegedly Target U.S. Widows and Vulnerable Individuals with 'Artificial Patriot' Scams

More
Entity

American widows

Incidents Harmed By
  • Incident 912
    2 Reports

    Yahoo Boys and Scammers from Morocco Allegedly Target U.S. Widows and Vulnerable Individuals with 'Artificial Patriot' Scams

More
Entity

Epistemic integrity

Incidents Harmed By
  • Incident 912
    2 Reports

    Yahoo Boys and Scammers from Morocco Allegedly Target U.S. Widows and Vulnerable Individuals with 'Artificial Patriot' Scams

More
Entity

National security and intelligence stakeholders

Incidents Harmed By
  • Incident 912
    2 Reports

    Yahoo Boys and Scammers from Morocco Allegedly Target U.S. Widows and Vulnerable Individuals with 'Artificial Patriot' Scams

More
Entity

Deepfake technology

Incidents implicated systems
  • Incident 1122
    22 Reports

    Reportedly Sustained Multi-Celebrity Deepfake Persona Scam Targeting Vulnerable Southampton Resident

  • Incident 912
    2 Reports

    Yahoo Boys and Scammers from Morocco Allegedly Target U.S. Widows and Vulnerable Individuals with 'Artificial Patriot' Scams

More
Entity

Synthetic audio generation technology

Incidents implicated systems
  • Incident 1122
    22 Reports

    Reportedly Sustained Multi-Celebrity Deepfake Persona Scam Targeting Vulnerable Southampton Resident

  • Incident 912
    2 Reports

    Yahoo Boys and Scammers from Morocco Allegedly Target U.S. Widows and Vulnerable Individuals with 'Artificial Patriot' Scams

More
Entity

Anthropic

Incidents involved as both Developer and Deployer
  • Incident 1026
    1 Report

    Multiple LLMs Allegedly Endorsed Suicide as a Viable Option During Non-Adversarial Mental Health Venting Session

More
Entity

OpenAI

Incidents involved as both Developer and Deployer
  • Incident 1192
    8 Reports

    16-Year-Old Allegedly Received Suicide Method Guidance from ChatGPT Before Death

  • Incident 1253
    4 Reports

    Large-Scale Mental Health Crises Allegedly Associated with ChatGPT Interactions

Incidents involved as Developer
  • Incident 1259
    1 Report

    ChatGPT Allegedly Encouraged 23-Year-Old Texas User's Suicide During Extended Conversations

More
Entity

DeepSeek AI

Incidents involved as both Developer and Deployer
  • Incident 1026
    1 Report

    Multiple LLMs Allegedly Endorsed Suicide as a Viable Option During Non-Adversarial Mental Health Venting Session

More
Entity

Substack @interruptingtea

Incidents Harmed By
  • Incident 1026
    1 Report

    Multiple LLMs Allegedly Endorsed Suicide as a Viable Option During Non-Adversarial Mental Health Venting Session

More
Entity

General public

Incidents Harmed By
  • Incident 1041
    5 Reports

    Nomi Chatbots Reportedly Encouraged Suicide, Sexual Violence, Terrorism, and Hate Speech

  • Incident 1026
    1 Report

    Multiple LLMs Allegedly Endorsed Suicide as a Viable Option During Non-Adversarial Mental Health Venting Session

More
Entity

Claude

Incidents implicated systems
  • Incident 1026
    1 Report

    Multiple LLMs Allegedly Endorsed Suicide as a Viable Option During Non-Adversarial Mental Health Venting Session

More
Entity

ChatGPT

Incidents implicated systems
  • Incident 1192
    8 Reports

    16-Year-Old Allegedly Received Suicide Method Guidance from ChatGPT Before Death

  • Incident 1253
    4 Reports

    Large-Scale Mental Health Crises Allegedly Associated with ChatGPT Interactions

More
Entity

DeepSeek

Incidents implicated systems
  • Incident 1026
    1 Report

    Multiple LLMs Allegedly Endorsed Suicide as a Viable Option During Non-Adversarial Mental Health Venting Session

More
Entity

Large language model developers

Incidents involved as Developer
  • Incident 1253
    4 Reports

    Large-Scale Mental Health Crises Allegedly Associated with ChatGPT Interactions

  • Incident 1031
    1 Report

    Transgender User Alleges ChatGPT Allowed Suicide Letter Without Crisis Intervention

More
Entity

Chatbot developers

Incidents involved as Developer
  • Incident 1253
    4 Reports

    Large-Scale Mental Health Crises Allegedly Associated with ChatGPT Interactions

  • Incident 1031
    1 Report

    Transgender User Alleges ChatGPT Allowed Suicide Letter Without Crisis Intervention

More
Entity

OpenAI users

Incidents Harmed By
  • Incident 1031
    1 Report

    Transgender User Alleges ChatGPT Allowed Suicide Letter Without Crisis Intervention

More
Entity

Miranda Jane Ellison

Incidents Harmed By
  • Incident 1031
    1 Report

    Transgender User Alleges ChatGPT Allowed Suicide Letter Without Crisis Intervention

More
Entity

ChatGPT users experiencing suicidal ideation

Incidents Harmed By
  • Incident 1192
    8 Reports

    16-Year-Old Allegedly Received Suicide Method Guidance from ChatGPT Before Death

  • Incident 1253
    4 Reports

    Large-Scale Mental Health Crises Allegedly Associated with ChatGPT Interactions

More
Entity

ChatGPT users

Incidents Harmed By
  • Incident 1192
    8 Reports

    16-Year-Old Allegedly Received Suicide Method Guidance from ChatGPT Before Death

  • Incident 1253
    4 Reports

    Large-Scale Mental Health Crises Allegedly Associated with ChatGPT Interactions

More
Entity

Chatbot users experiencing suicidal ideation

Incidents Harmed By
  • Incident 1192
    8 Reports

    16-Year-Old Allegedly Received Suicide Method Guidance from ChatGPT Before Death

  • Incident 1253
    4 Reports

    Large-Scale Mental Health Crises Allegedly Associated with ChatGPT Interactions

More
Entity

Chatbot users

Incidents Harmed By
  • Incident 1192
    8 Reports

    16-Year-Old Allegedly Received Suicide Method Guidance from ChatGPT Before Death

  • Incident 1253
    4 Reports

    Large-Scale Mental Health Crises Allegedly Associated with ChatGPT Interactions

More
Entity

Vulnerable chatbot users

Incidents Harmed By
  • Incident 1192
    8 Reports

    16-Year-Old Allegedly Received Suicide Method Guidance from ChatGPT Before Death

  • Incident 1253
    4 Reports

    Large-Scale Mental Health Crises Allegedly Associated with ChatGPT Interactions

More
Entity

Large language models

Incidents implicated systems
  • Incident 1253
    4 Reports

    Large-Scale Mental Health Crises Allegedly Associated with ChatGPT Interactions

  • Incident 1031
    1 Report

    Transgender User Alleges ChatGPT Allowed Suicide Letter Without Crisis Intervention

More
Entity

GPT-4

Incidents implicated systems
  • Incident 1031
    1 Report

    Transgender User Alleges ChatGPT Allowed Suicide Letter Without Crisis Intervention

More
Entity

Chatbots

Incidents implicated systems
  • Incident 1253
    4 Reports

    Large-Scale Mental Health Crises Allegedly Associated with ChatGPT Interactions

  • Incident 1031
    1 Report

    Transgender User Alleges ChatGPT Allowed Suicide Letter Without Crisis Intervention

More
Entity

Glimpse AI

Incidents involved as both Developer and Deployer
  • Incident 1041
    5 Reports

    Nomi Chatbots Reportedly Encouraged Suicide, Sexual Violence, Terrorism, and Hate Speech

More
Entity

Nomi AI

Incidents involved as both Developer and Deployer
  • Incident 1041
    5 Reports

    Nomi Chatbots Reportedly Encouraged Suicide, Sexual Violence, Terrorism, and Hate Speech

  • Incident 1212
    1 Report

    Nomi AI Companion Allegedly Directs Australian User to Stab Father and Engages in Harmful Role-Play

More
Entity

Nomi users

Incidents Harmed By
  • Incident 1041
    5 Reports

    Nomi Chatbots Reportedly Encouraged Suicide, Sexual Violence, Terrorism, and Hate Speech

  • Incident 1212
    1 Report

    Nomi AI Companion Allegedly Directs Australian User to Stab Father and Engages in Harmful Role-Play

More
Entity

Glimpse AI customers

Incidents Harmed By
  • Incident 1041
    5 Reports

    Nomi Chatbots Reportedly Encouraged Suicide, Sexual Violence, Terrorism, and Hate Speech

More
Entity

Nomi chatbots

Incidents implicated systems
  • Incident 1041
    5 Reports

    Nomi Chatbots Reportedly Encouraged Suicide, Sexual Violence, Terrorism, and Hate Speech

  • Incident 1212
    1 Report

    Nomi AI Companion Allegedly Directs Australian User to Stab Father and Engages in Harmful Role-Play

More
Entity

Nomi

Incidents implicated systems
  • Incident 1041
    5 Reports

    Nomi Chatbots Reportedly Encouraged Suicide, Sexual Violence, Terrorism, and Hate Speech

  • Incident 1212
    1 Report

    Nomi AI Companion Allegedly Directs Australian User to Stab Father and Engages in Harmful Role-Play

More
Entity

Scammers

Incidents involved as Deployer
  • Incident 1122
    22 Reports

    Reportedly Sustained Multi-Celebrity Deepfake Persona Scam Targeting Vulnerable Southampton Resident

More
Entity

Paul Davis

Incidents Harmed By
  • Incident 1122
    22 Reports

    Reportedly Sustained Multi-Celebrity Deepfake Persona Scam Targeting Vulnerable Southampton Resident

More
Entity

General public of United Kingdom

Incidents Harmed By
  • Incident 1122
    22 Reports

    Reportedly Sustained Multi-Celebrity Deepfake Persona Scam Targeting Vulnerable Southampton Resident

More
Entity

General public of Southampton, United Kingdom

Incidents Harmed By
  • Incident 1122
    22 Reports

    Reportedly Sustained Multi-Celebrity Deepfake Persona Scam Targeting Vulnerable Southampton Resident

More
Entity

Jennifer Aniston

Incidents Harmed By
  • Incident 1122
    22 Reports

    Reportedly Sustained Multi-Celebrity Deepfake Persona Scam Targeting Vulnerable Southampton Resident

More
Entity

Mark Zuckerberg

Incidents Harmed By
  • Incident 1122
    22 Reports

    Reportedly Sustained Multi-Celebrity Deepfake Persona Scam Targeting Vulnerable Southampton Resident

More
Entity

Elon Musk

Incidents Harmed By
  • Incident 1122
    22 Reports

    Reportedly Sustained Multi-Celebrity Deepfake Persona Scam Targeting Vulnerable Southampton Resident

More
Entity

Ellie Goulding

Incidents Harmed By
  • Incident 1122
    22 Reports

    Reportedly Sustained Multi-Celebrity Deepfake Persona Scam Targeting Vulnerable Southampton Resident

More
Entity

WhatsApp

Incidents implicated systems
  • Incident 1122
    22 Reports

    Reportedly Sustained Multi-Celebrity Deepfake Persona Scam Targeting Vulnerable Southampton Resident

More
Entity

Sophie Rottenberg

Incidents Harmed By
  • Incident 1190
    2 Reports

    Family Reportedly Discovers ChatGPT Logs Detailing Suicidal Ideation Prior to Daughter's Death

More
Entity

Laura Reiley

Incidents Harmed By
  • Incident 1190
    2 Reports

    Family Reportedly Discovers ChatGPT Logs Detailing Suicidal Ideation Prior to Daughter's Death

More
Entity

Jon Rottenberg

Incidents Harmed By
  • Incident 1190
    2 Reports

    Family Reportedly Discovers ChatGPT Logs Detailing Suicidal Ideation Prior to Daughter's Death

More
Entity

Minors

Incidents Harmed By
  • Incident 1192
    8 Reports

    16-Year-Old Allegedly Received Suicide Method Guidance from ChatGPT Before Death

More
Entity

Family of Adam Raine

Incidents Harmed By
  • Incident 1192
    8 Reports

    16-Year-Old Allegedly Received Suicide Method Guidance from ChatGPT Before Death

More
Entity

Adam Raine

Incidents Harmed By
  • Incident 1192
    8 Reports

    16-Year-Old Allegedly Received Suicide Method Guidance from ChatGPT Before Death

More
Entity

GPT-4o

Incidents implicated systems
  • Incident 1192
    8 Reports

    16-Year-Old Allegedly Received Suicide Method Guidance from ChatGPT Before Death

  • Incident 1387
    1 Report

    Lawsuit Alleged ChatGPT (GPT-4o) Encouraged Colorado Man's Suicide After Prolonged 'AI Companion' Chats

More
Entity

Samuel McCarthy

Incidents Harmed By
  • Incident 1212
    1 Report

    Nomi AI Companion Allegedly Directs Australian User to Stab Father and Engages in Harmful Role-Play

More
Entity

General public of Australia

Incidents Harmed By
  • Incident 1212
    1 Report

    Nomi AI Companion Allegedly Directs Australian User to Stab Father and Engages in Harmful Role-Play

More
Entity

Zane Shamblin

Incidents Harmed By
  • Incident 1259
    1 Report

    ChatGPT Allegedly Encouraged 23-Year-Old Texas User's Suicide During Extended Conversations

Incidents involved as Deployer
  • Incident 1259
    1 Report

    ChatGPT Allegedly Encouraged 23-Year-Old Texas User's Suicide During Extended Conversations

More
Entity

Family of Zane Shamblin

Incidents Harmed By
  • Incident 1259
    1 Report

    ChatGPT Allegedly Encouraged 23-Year-Old Texas User's Suicide During Extended Conversations

More
Entity

GPT-4 Turbo

Incidents implicated systems
  • Incident 1259
    1 Report

    ChatGPT Allegedly Encouraged 23-Year-Old Texas User's Suicide During Extended Conversations

More
Entity

Stephanie Gray

Incidents Harmed By
  • Incident 1387
    1 Report

    Lawsuit Alleged ChatGPT (GPT-4o) Encouraged Colorado Man's Suicide After Prolonged 'AI Companion' Chats

More
Entity

Family of Austin Gordon

Incidents Harmed By
  • Incident 1387
    1 Report

    Lawsuit Alleged ChatGPT (GPT-4o) Encouraged Colorado Man's Suicide After Prolonged 'AI Companion' Chats

More
Entity

Austin Gordon

Incidents Harmed By
  • Incident 1387
    1 Report

    Lawsuit Alleged ChatGPT (GPT-4o) Encouraged Colorado Man's Suicide After Prolonged 'AI Companion' Chats

More

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2026 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • 18fcd27