Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse

Report 3770

Associated Incidents

Incident 64535 Report
Seeming Pattern of Gemini Bias and Sociotechnical Training Failures Harm Google's Reputation

Loading...
Google Suspends AI Tool's Image Generation of People After It Created Historical 'Inaccuracies,' Including Racially Diverse WWII-Era Nazi Soldiers
variety.com · 2024

After critics slammed Google‘s “woke” generative AI system, the company halted the ability of its Gemini tool to create images of people to fix what it acknowledged were “inaccuracies in some historical image generation depictions.”

Google’s Gemini, formerly known as Bard, began offering text-to-image generative features this month. The problem appeared to be that, in trying to compensate for gender- and racial-representation bias in AI, the system was creating ahistorical images of people.

Among the bizarre results generated by Google Gemini that users posted on social media was a racially diverse group of images depicting a “1943 German soldier,” as shared by X user JohnLu0x:

Other historically anomalous images generated by Google Gemini included Black Vikings; a woman as the Catholic pope; women NHL players; the founders of Google depicted as Asian men; and non-white people in a scene of the U.S.’s Founding Fathers.

In a statement early Thursday, Google said, “We’re already working to address recent issues with Gemini’s image generation feature. While we do this, we’re going to pause the image generation of people and will re-release an improved version soon,”

“We’re aware that Gemini is offering inaccuracies in some historical image generation depictions,” the tech giant said in a statement on Feb. 22, after users reported the errors. “We’re working to improve these kinds of depictions immediately. Gemini’s Al image generation does generate a wide range of people. And that’s generally a good thing because people around the world use it. But it’s missing the mark here.”

Critics lambasted Google’s corporate culture for the Gemini snafus. “The ridiculous images generated by Gemini aren’t an anomaly. They’re a self-portrait of Google’s bureaucratic corporate culture,” computer scientist and investor Paul Graham wrote in a post on X. “The bigger your cash cow, the worse your culture can get without driving you out of business. And Google’s cash cow, search advertising, is one of the biggest the world has ever seen.”

Right-wing commentator Ashley St. Clair framed the controversy in a broader culture-war context. “What’s happening with Google’s woke Gemini AI has been happening for years in Media and Hollywood and everybody who called it out was called racist and shunned from society,” St. Clair wrote in a post on X.

Read the Source

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2024 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • e1b50cd