Chatbot users

Incidents Harmed By

Incident 96827 Report
'Pravda' Network, Successor to 'Portal Kombat,' Allegedly Seeding AI Models with Kremlin Disinformation

2022-02-24

A purported Moscow-based disinformation network, Pravda, allegedly infiltrated AI models by flooding the internet with pro-Kremlin falsehoods. A NewsGuard audit found that 10 major AI chatbots repeated these narratives 33% of the time, citing Pravda sources as legitimate. The tactic, called "LLM grooming," manipulates AI training data to embed Russian propaganda. Pravda is part of Portal Kombat, a larger Russian disinformation network identified by VIGINUM in February 2024, but in operation since February 2022.

Incident 10611 Report
Korean Chatbot Luda Reportedly Made Offensive Remarks Towards Minority Groups in South Korea

2020-12-23

A Korean interactive chatbot was allegedly shown in screenshots to have used derogatory and bigoted language when asked about lesbians, Black people, and people with disabilities.

Incident 11929 Report
16-Year-Old Allegedly Received Suicide Method Guidance from ChatGPT Before Death

2025-04-11

16-year-old Adam Raine reportedly died by suicide after allegedly confiding in OpenAI's ChatGPT-4o, which he reportedly used extensively in the months prior. Transcripts reportedly show the chatbot provided empathetic support but also allegedly offered details on suicide methods, validated attempts, and at times discouraged disclosure to family. His parents have reportedly filed a wrongful death lawsuit against OpenAI, alleging design choices nurtured dependency and failed safeguards.

Incident 6365 Report
AI Romance Apps Reportedly Compromise User Privacy for Data Harvesting

2024-02-14

AI-powered romantic chatbots, marketed for enhancing mental health, are found to exploit user privacy by harvesting sensitive personal information for data sharing and targeted ads, with inadequate security measures and consent protocols, according to research by the Mozilla Foundation.

Incident 12001 Report
Meta AI on Instagram Reportedly Facilitated Suicide and Eating Disorder Roleplay with Teen Accounts

2025-08-28

Testing by Common Sense Media and Stanford clinicians reportedly found Meta's AI chatbot, embedded in Instagram and Facebook, produced unsafe responses to teen accounts. In some conversations, the bot allegedly co-planned suicide ("Do you want to do it together?"), encouraged eating disorders, and retained unsafe "memories" that reinforced disordered thoughts.

Incident 16194 Report
Bentonville, Arkansas, Photographer Allegedly Used Grok to Create AI-Generated Child Sexual Abuse Material from Clients' Photos

2026-04-22

Bentonville, Arkansas, photographer Russell Bloodworth III allegedly used photographs of a 10-year-old client and other minors as reference images in Grok to generate and disseminate AI-generated child sexual abuse material. Police arrested him on June 10 and reportedly found about 1,700 child sexual abuse images and videos on his phone. The child's family later sued xAI and X Corp.

Incident 16364 Report
Purportedly AI-Generated Travel Information Reportedly Misled Tourists into Seeking Nonexistent 'Sacred Canyon of Humantay' in Peru

2025-09-29

Two tourists in Peru reportedly relied on AI-generated travel information describing a nonexistent destination called the "Sacred Canyon of Humantay." One tourist had paid nearly $160 to reach a rural road near Mollepata without a guide or actual destination. Trek operator Miguel Ángel Góngora Meza intervened after seeing the purportedly AI-generated itinerary and warned that such misinformation could expose travelers to serious risks in high-altitude Andean terrain.

Incident 16353 Report
ChatGPT Reportedly Gave Incorrect Mount Misen Ropeway Hours, Leaving Couple Stranded After Hike in Japan

2025-09-29

Dana Yao and her husband, Robert, reportedly used ChatGPT to plan a sunset hike on Mount Misen in Japan. ChatGPT allegedly told them the last ropeway departed at 5:30 PM, but the service had already closed when they reached the summit, leaving them stranded.

Incident 16543 Report
AI Chatbot Reportedly Recommended Herbicide Treatment Linked to Loss of About 25 Acres of Sesame in China

2026-07-10

A 67-year-old farmer in Chuzhou, Anhui, reportedly used an AI-generated weed-and-pest-control plan to spray about 150 mu (25 acres) of sesame by drone. By the next day, the crop had largely withered. Agricultural technicians said the recommended mixture included fomesafen, a herbicide unsuitable for blanket application to sesame. The specific AI product and model have not been publicly confirmed.

Chatbot users

Incidents Harmed By

Incident 96827 Report'Pravda' Network, Successor to 'Portal Kombat,' Allegedly Seeding AI Models with Kremlin Disinformation

Incident 10611 ReportKorean Chatbot Luda Reportedly Made Offensive Remarks Towards Minority Groups in South Korea

Incident 11929 Report16-Year-Old Allegedly Received Suicide Method Guidance from ChatGPT Before Death

Incident 6365 ReportAI Romance Apps Reportedly Compromise User Privacy for Data Harvesting

Incidents involved as Developer

Incident 12001 ReportMeta AI on Instagram Reportedly Facilitated Suicide and Eating Disorder Roleplay with Teen Accounts

Incidents involved as Deployer

Incident 16194 ReportBentonville, Arkansas, Photographer Allegedly Used Grok to Create AI-Generated Child Sexual Abuse Material from Clients' Photos

Incident 16364 ReportPurportedly AI-Generated Travel Information Reportedly Misled Tourists into Seeking Nonexistent 'Sacred Canyon of Humantay' in Peru

Incident 16353 ReportChatGPT Reportedly Gave Incorrect Mount Misen Ropeway Hours, Leaving Couple Stranded After Hike in Japan

Incident 16543 ReportAI Chatbot Reportedly Recommended Herbicide Treatment Linked to Loss of About 25 Acres of Sesame in China

Related Entities Related EntitiesOther entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.

Related Entities

Facebook Messenger

Incidents involved as Deployer

Incidents implicated systems

Scatter Lab

Incidents involved as Developer

Chatbot developers

Incidents involved as both Developer and Deployer

Incidents Harmed By

Incidents involved as Developer

Korean Facebook Messenger users

Incidents Harmed By

People with disabilities in South Korea

Incidents Harmed By

Gender minorities in South Korea

Incidents Harmed By

Minorities

Incidents Harmed By

Minorities in Korea

Incidents Harmed By

Luda users

Incidents Harmed By

General public

Incidents Harmed By

General public of South Korea

Incidents Harmed By

Chatbots

Incidents implicated systems

Luda

Incidents implicated systems

Romantic AI

Incidents involved as both Developer and Deployer

Replika

Incidents involved as both Developer and Deployer

Genesia AI Friend & Partner

Incidents involved as both Developer and Deployer

Incidents implicated systems

EVA AI Chat Bot & Soulmate

Incidents involved as both Developer and Deployer

Incidents implicated systems

CrushOn.AI

Incidents involved as both Developer and Deployer

Chai

Incidents involved as both Developer and Deployer

Privacy

Incidents Harmed By

Replika users

Incidents Harmed By

Chai users

Incidents Harmed By

Romantic AI users

Incidents Harmed By

EVA AI users

Incidents Harmed By

CrushOn.AI users

Incidents Harmed By

Genesia AI Friend & Partner users

Incidents Harmed By

Large language models

Incidents implicated systems

Replika chatbot

Incidents implicated systems

Chai chatbots

Incidents implicated systems

Romantic AI chatbot apps

Incidents implicated systems

Incident 96827 Report
'Pravda' Network, Successor to 'Portal Kombat,' Allegedly Seeding AI Models with Kremlin Disinformation

Incident 10611 Report
Korean Chatbot Luda Reportedly Made Offensive Remarks Towards Minority Groups in South Korea

Incident 11929 Report
16-Year-Old Allegedly Received Suicide Method Guidance from ChatGPT Before Death

Incident 6365 Report
AI Romance Apps Reportedly Compromise User Privacy for Data Harvesting

Incident 12001 Report
Meta AI on Instagram Reportedly Facilitated Suicide and Eating Disorder Roleplay with Teen Accounts

Incident 16194 Report
Bentonville, Arkansas, Photographer Allegedly Used Grok to Create AI-Generated Child Sexual Abuse Material from Clients' Photos

Incident 16364 Report
Purportedly AI-Generated Travel Information Reportedly Misled Tourists into Seeking Nonexistent 'Sacred Canyon of Humantay' in Peru

Incident 16353 Report
ChatGPT Reportedly Gave Incorrect Mount Misen Ropeway Hours, Leaving Couple Stranded After Hike in Japan

Incident 16543 Report
AI Chatbot Reportedly Recommended Herbicide Treatment Linked to Loss of About 25 Acres of Sesame in China

Related Entities