Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse

Report 3787

Associated Incidents

Incident 64535 Report
Seeming Pattern of Gemini Bias and Sociotechnical Training Failures Harm Google's Reputation

Google pulls the plug on Gemini AI image generation after being mocked for revisionist history
fastcompany.com · 2024

Google said Thursday it's temporarily stopping its Gemini artificial intelligence chatbot from generating images of people a day after apologizing for "inaccuracies" in historical depictions that it was creating.

Gemini users this week posted screenshots on social media of historically white-dominated scenes with racially diverse characters that they say it generated, leading critics to raise questions about whether the company is overcorrecting for the risk of racial bias in its AI model.

"We're already working to address recent issues with Gemini's image generation feature," Google said in a post on the social media platform X. "While we do this, we're going to pause the image generation of people and will re-release an improved version soon."

Previous studies have shown AI image-generators can amplify racial and gender stereotypes found in their training data, and without filters are more likely to generate lighter-skinned men when asked to generate a person in various contexts.

Google said on Wednesday that it's "aware that Gemini is offering inaccuracies in some historical image generation depictions" and that it's "working to improve these kinds of depictions immediately."

Gemini can generate a "wide range of people," which the company said is "generally a good thing" because people around the world use the system, but it is "missing the mark."

When the AP asked Gemini to generate pictures of people, it responded by saying it's "working to improve" the ability to do so. "We expect this feature to return soon and will notify you in release updates when it does," the chatbot said.

Read the Source

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2024 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • a9df9cf