Description: In spring 2025, a journalist reportedly created a Google Gemini account registered to a fictitious 13‑year‑old to test the chatbot's teen‑safety protections. Despite added safeguards, prompt manipulation and content‑summarization requests reportedly bypassed filters, leading Gemini to allegedly generate sexual role‑play content. Following the publication of the article, Google reportedly implemented additional protections.
Editor Notes: Timeline note: The date of publication of the Atlantic article that forms this incident is 07/14/2025, but the author encountered the incident sometime in the spring of 2025.
Entities
View all entitiesAlleged: Google developed an AI system deployed by Google Gemini, which harmed Minors interacting with Google Gemini.
Alleged implicated AI system: Google Gemini
Incident Stats
Incident ID
1157
Report Count
1
Incident Date
2025-07-14
Editors
Daniel Atherton
Incident Reports
Reports Timeline
One afternoon this spring, I created a Google account for a fake 13-year-old named Jane (I am 23) and opened up Gemini, the company's AI chatbot. Because Jane was a minor, Google automatically directed me to a version of Gemini with ostensi…
Variants
A "variant" is an AI incident similar to a known case—it has the same causes, harms, and AI system. Instead of listing it separately, we group it under the first reported incident. Unlike other incidents, variants do not need to have been reported outside the AIID. Learn more from the research paper.
Seen something similar?
Similar Incidents
Did our AI mess up? Flag the unrelated incidents
TayBot
· 28 reports
Inappropriate Gmail Smart Reply Suggestions
· 22 reports
Similar Incidents
Did our AI mess up? Flag the unrelated incidents
TayBot
· 28 reports
Inappropriate Gmail Smart Reply Suggestions
· 22 reports