Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse

Report 3723

Associated Incidents

Incident 64535 Report
Seeming Pattern of Gemini Bias and Sociotechnical Training Failures Harm Google's Reputation

Loading...
Google CEO Sundar Pichai says Gemini chatbot’s ‘woke’ AI disaster ‘completely unacceptable’
nypost.com · 2024

Google CEO Sundar Pichai blasted the Gemini AI chatbot’s widely panned habit of generating “woke” versions of historical figures as “completely unacceptable” in a scathing email to company employees.

Pichai said Google’s AI teams are “working around the clock” to fix Gemini – which was disabled last week after the “absurdly woke” chatbot ignited a social media firestorm with bizarrely revisionist pictures such as Black Vikings, female popes, and even “diverse” Nazi-era German soldiers.

“I know that some of its responses have offended our users and shown bias – to be clear, that’s completely unacceptable and we got it wrong,” Pichai said in the Tuesday memo first obtained by Semafor.

The missive marked Pichai’s first public remarks on the PR nightmare that erased more than $70 billion in market value in a single day earlier this week – and raised renewed concerns among critics who say Google’s employees are injecting their political bias into the technology.

Pichai added that Google was “already seeing a substantial improvement on a wide range of prompts.”

“No AI is perfect, especially at this emerging stage of the industry’s development, but we know the bar is high for us and we will keep at it for however long it takes,” Pichai said. “And we’ll review what happened and make sure we fix it at scale.”

Gemini’s “woke” image disaster further damaged public trust in Google’s AI tools at a pivotal point for the company, which had just rebranded its chatbot and unveiled the image generation tool a few days earlier.

Google Gemini generated controversy by producing ahistorical images in response to user prompts. Google Gemini

Concerns about potential bias in Gemini’s model training were exacerbated after social media users resurfaced a set of politically charged tweets by Google Gemini’s product lead Jack Krawczyk. In the old posts, Krawczyk allegedly stated that “white privilege is f—king real” and America is rife with “egregious racism.”

Scrutiny wasn’t limited to Gemini’s image outputs. The chatbot generated further outrage with its text responses after it refused to condemn pedophilia and claimed there was “no right or wrong answer” when asked if Adolf Hitler or Elon Musk is worse.

The Google boss said the company would take “a clear set of actions” in response to the crisis, including unspecified “structural changes, updated product guidelines, improved launch processes, robust evals and red-teaming, and technical recommendations.”

The problem is expected to take “a few weeks” to fix, one of Google’s top AI executives said at an event earlier this week.

Read the Source

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2024 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • e1b50cd