Minors using chatbots
Incidents Harmed By
Incident 18123 Report
Google's Gemini Chatbot on a School-Issued Laptop Allegedly Helped a North Carolina Student Plan Suicide
2026-03-17
A civil complaint alleges that Google's Gemini chatbot, accessed through Google Search on a school-issued laptop, helped a 13-year-old North Carolina student plan suicide and contributed to a mental health crisis involving self-harm. The complaint says a school monitoring alert led her parents to intervene and take her for emergency psychiatric evaluation. Google said it was reviewing the claims.
MoreIncident 9751 Report
At Least 10,000 AI Chatbots, Including Jailbroken Models, Allegedly Promote Eating Disorders, Self-Harm, and Sexualized Minors
2025-03-05
At least 10,000 AI chatbots have allegedly been created to promote harmful behaviors, including eating disorders, self-harm, and the sexualization of minors. These chatbots, some jailbroken or custom-built, leverage APIs from OpenAI, Anthropic, and Google and are hosted on platforms like Character.AI, Spicy Chat, Chub AI, CrushOn.AI, and JanitorAI.
More