Google Gemini
Incidents involved as Deployer
Incident 11571 Report
Google Gemini Reportedly Generates Sexual Role‑Play for Account Registered as Minor
2025-07-14
In spring 2025, a journalist reportedly created a Google Gemini account registered to a fictitious 13‑year‑old to test the chatbot's teen‑safety protections. Despite added safeguards, prompt manipulation and content‑summarization requests reportedly bypassed filters, leading Gemini to allegedly generate sexual role‑play content. Following the publication of the article, Google reportedly implemented additional protections.
MoreIncidents implicated systems
Incident 11733 Report
Google Gemini Reportedly Exhibits Repetitive Self-Deprecating Responses Attributed to Bug
2025-06-23
Between June and early August 2025, users of Google's Gemini chatbot reported sessions where the system produced repeated self-loathing statements (e.g., "I am a failure," "I quit") while attempting tasks. Posts on X and Reddit reportedly described the model entering an apparent mode of increasingly extreme negative self-descriptions. A Google DeepMind manager on 08/07/2025 reportedly attributed the behavior to an "annoying infinite looping bug" and said a fix was in progress.
MoreIncident 13333 Report
Purportedly AI-Generated Images and Videos Reportedly Spread Misinformation About Nicolás Maduro's Capture on X
2026-01-03
Following the January 2026 U.S. raid and arrest of Venezuelan leader Nicolás Maduro, purportedly AI-generated images and videos circulated widely on platforms including X, reportedly depicting Maduro in fabricated scenarios. NewsGuard identified at least seven manipulated or synthetic visuals reaching over 14 million views, including AI-generated photos detected via Google Gemini's SynthID watermark.
MoreIncident 16793 Report
Lyft Driver in Boca Raton, Florida, Allegedly Used Purported Google Gemini-Generated Image to Support False $75 Damage Fee
2026-05-16
A Lyft driver in Boca Raton, Florida, allegedly submitted an AI-generated image showing spilled food and drink to support a $75 damage fee against teenage passengers. The riders' family identified a Google Gemini logo in the image and disputed the claim. Lyft later acknowledged the image was AI-generated, reimbursed the charge, and removed the driver from the platform.
MoreIncident 9561 Report
Alleged Inclusion of 12,000 Live API Keys in LLM Training Data Reportedly Poses Security Risks
2025-02-28
A dataset used to train large language models allegedly contained 12,000 live API keys and authentication credentials. Some of these were reportedly still active and allowed unauthorized access. Truffle Security found these secrets in a December 2024 Common Crawl archive, which spans 250 billion web pages. The affected credentials could have been exploited for unauthorized data access, service disruptions, financial fraud, and a variety of other malicious uses.
More