Incident 273: FaceApp Predicted Different Genders for Similar User Photos with Slight Variations

Description: FaceApp’s algorithm was reported by a user to have predicted different genders for two mostly identical facial photos with only a slight difference in eyebrow thickness.
Alleged: FaceApp developed and deployed an AI system, which harmed FaceApp non-binary presenting users , FaceApp transgender users and FaceApp users.

Suggested citation format

Dickinson, Ingrid. (2020-12-24) Incident Number 273. in Lam, K. (ed.) Artificial Intelligence Incident Database. Responsible AI Collaborative.

Incident Stats

Incident ID
273
Report Count
1
Incident Date
2020-12-24
Editors
Khoa Lam

Reports Timeline

Tools

New ReportNew ReportDiscoverDiscover

Incidents Reports

I’d like to talk a little bit about algorithms, dysphoria, and dysmorphia.

I’ve struggled with algorithms. I’ll often take a picture and run it through FaceApp to get gendered.

I recently noticed that when my eyebrows are thin, it says I am female. Thicker, male. Let’s talk.

These two pictures are the exact same. No makeup. The first is me just out of the shower. The second is after I put some concealer over my brows, that I am regrowing right now for a “brow reset.”

In the first I am gendered male, in the second I am gendered female.

I have a suspicion that even after I clean them up in the first, once my reset is over, I’ll still get gendered male by the algorithm if I keep them thick, which is what the current style is.

What do you do when current trends of thicker eyebrows on women make you fit in more as a woman but make apps gender you male and trigger your dysphoria?

I felt trapped. Either decision would result in distress.

This isn’t unique to FaceApp. The how-old site seems to hate glasses. When I wear glasses, 31 year old male. When I don’t, 24 year old female.

Nobody is gendering you based on whether you wear glasses. And eyebrows, while they can help you get gendered properly, aren’t essential. Or are they?

These are the thoughts that run through my head, and why take a risk?

So I overplucked my brows and haven’t worn glasses.

Tweet: @ErinInTheMorn

Similar Incidents

By textual similarity

Did our AI mess up? Flag the unrelated incidents

FaceApp Racial Filters

· 23 reports