Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse

Report 1457

Associated Incidents

Incident 12712 Report
Microsoft’s Algorithm Allegedly Selected Photo of the Wrong Mixed-Race Person Featured in a News Story

Backlash after Microsoft's robot editor confuses mixed-race Little Mix singers
thehill.com · 2020

A week after laying off dozens of journalists and editorial workers and replacing them with artificial intelligence, Microsoft’s robot editor confused two members of the British singing group Little Mix, who are both mixed-race.

Singer Jade Thirlwall first called out the mistake on her Instagram story tagging MSN, where a story about her experience with racism was paired with a photo of singer Leigh-Anne Pinnock.

“@MSN If you’re going to copy and paste articles from other accurate media outlets, you might want to make sure you’re using an image of the correct mixed race member of the group," she wrote, adding, "This s--- happens to @leighannepinnock and I ALL THE TIME that it’s become a running joke...It offends me that you couldn’t differentiate the two women of colour out of four members of a group...DO BETTER!”

The article "Little Mix star Jade Thirlwall says she faced horrific racism at school" drew from an interview the 27-year-old gave on the BBC podcast "No Country for Young Women." Thirlwall, whose mother is Egyptian and Yemeni and father is English, spoke about being bullied for her heritage growing up.

Pinnock, who has Barbadian and Jamaican ancestry, later called out the mistake on her own social media.

A spokesman for Microsoft, which owns MSN, told the Guardian, “As soon as we became aware of this issue, we immediately took action to resolve it and have replaced the incorrect image.”

In a previous story about the move to replace human editors with Microsoft’s artificial intelligence software, The Guardian reported former staff members’ concerns over potential mistakes like this one. A Guardian reporter later said on Twitter that unnamed staff members at MSN were ordered to remove The Guardian article on the mix-up once it was published.

Microsoft, who has issued statements in support of the black and African American community at their company, has also come under fire for an email sent to an artist about commissioning a mural.

Microsoft chief marketing officer Chris Capossela responded to the Tweet, apologizing on behalf of the company.

“There is no excuse. We recognize it was wrong and I am sorry. I respect you may not want to discuss this further, but if you are open to it, I’d like to connect directly," he wrote.

Harris Diamond, the chief executive officer of advertising company McCann, which lists Microsoft as a client, also apologized in a response on Twitter.

Read the Source

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2024 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • 300d90c