Parents
Incidents Harmed By
Incident 12775 Report
Alleged Harmful Outputs and Data Exposure in Children's AI Products by FoloToy, Miko, and Character.AI
2025-11-21
AI children's products by FoloToy (Kumma), Miko (Miko 3), and Character.AI (custom chatbots) reportedly and allegedly produced harmful outputs, including purported sexual content, suicide-related advice, and manipulative emotional messaging. Some systems also allegedly exposed user data. Several toys reportedly used OpenAI models.
MoreIncident 8222 Report
Algorithmic Bias in French Welfare System Allegedly Discriminates Against Marginalized Groups
2024-10-15
A coalition of 15 human rights groups has launched legal action against the French government alleging that an algorithm used to detect welfare fraud discriminates against single mothers and disabled people. The algorithm assigns risk scores based on personal data. The process allegedly subjects vulnerable recipients to invasive investigations, violates privacy and anti-discrimination laws, and disproportionately affects marginalized groups.
MoreIncident 781 Report
International Baccalaureate’s 2020 Calculated-Grades Model Reportedly Lowered Students' Scores and College Prospects
2020-07-06
After Covid-19 canceled May 2020 exams, the Geneva-based International Baccalaureate reportedly used a calculated-grades model based on coursework, predicted grades, and historical school results to estimate final marks. Students, parents, and teachers reportedly said the opaque model produced unexpectedly low scores, threatening university admissions, scholarships, and study plans across multiple countries.
MoreIncident 7911 Report
Google AI Error Prompts Parents to Use Fecal Matter in Child Training Exercise
2024-09-09
Google's AI Overview feature mistakenly advised parents to use human feces in a potty training exercise, misinterpreting a method that uses shaving cream or peanut butter as a substitute. This incident is another example of an AI failure in grasping contextual nuances that can lead to potentially harmful, and in this case unsanitary, recommendations. Google has acknowledged the error.
More