Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse

Report 1103

Associated Incidents

Incident 6023 Report
FaceApp Racial Filters

Loading...
FaceApp sorry for 'racist' filter that lightens skin to make users 'hot'
bbc.co.uk · 2017

The makers of a face-morphing app have apologised after users accused them of creating a "racist" filter.

FaceApp can change portraits to make people look older, change gender or become "more attractive".

But when users with darker skin tones apply the "hot" filter to pictures, they say the app lightened their faces.

Reviews online also suggested users had seen their skin become lighter when trying this option.

"On a picture of a friend of mine it lightened her skin, took away her glasses, and changed all of her features so that she was unrecognisable," one reviewer wrote.

"Overall, this app only fully works for white men who don't wear glasses."

Yaroslav Goncharov, CEO and founder of the company which makes the app, has issued an apology.

"We are deeply sorry for this unquestionably serious issue," he said in a statement given to Newsbeat.

"It is an unfortunate side-effect of the underlying neural network caused by the training set bias, not intended behaviour."

The "neural network" is a computer system modelled on the human brain and nervous system.

FaceApp uses artificial intelligence to morph faces by merging facial features.

"To mitigate the issue, we have renamed the effect to exclude any positive connotation associated with it," said Mr Goncharov.

"We are also working on the complete fix that should arrive soon."

The "hot" filter is now known as "spark" on FaceApp, however it still has the effect of lightening the skin.

Other apps have been criticised in the past for filtering skin colour.

A controversial Snapchat face filter drew outrage from thousands of users, who described it as a "racist" caricature of East Asians.

Described as "yellowface" by angry users, it contorted facial features and gave users the appearance of slanted eyes.

Find us on Instagram at BBCNewsbeat and follow us on Snapchat, search for bbc_newsbeat

Read the Source

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2024 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • e1b50cd