Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Entities

UK Home Office

Incidents involved as both Developer and Deployer

Incident 3364 Report
UK Home Office's Sham Marriage Detection Algorithm Reportedly Flagged Certain Nationalities Disproportionately

2015-03-01

UK Home Office's opaque algorithm to detect sham marriages flagged some nationalities for investigation more than others, raising fears surrounding discrimination based on nationality and age.

More

Incident 871 Report
UK passport photo checker shows bias against dark-skinned women

2020-10-07

UK passport photo checker shows bias against dark-skinned women.

More

Incidents Harmed By

Incident 1621 Report
ETS Used Allegedly Flawed Voice Recognition Evidence to Accuse and Assess Scale of Cheating, Causing Thousands to be Deported from the UK

2014-01-01

International testing organization ETS admits voice recognition as evidence of cheating for thousands of previous TOEIC test-takers that reportedly included wrongfully accused people, causing them to be deported without an appeal process or seeing their incriminating evidence.

More

Incidents involved as Developer

Incident 3358 Report
UK Visa Streamline Algorithm Allegedly Discriminated Based on Nationality

2015-03-01

UK Home Office's algorithm to assess visa application risks explicitly considered nationality, allegedly caused candidates to face more scrutiny and discrimination.

More

Related Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
 

Entity

dark-skinned people

Incidents Harmed By
  • Incident 87
    1 Report

    UK passport photo checker shows bias against dark-skinned women

More
Entity

dark-skinned women

Incidents Harmed By
  • Incident 87
    1 Report

    UK passport photo checker shows bias against dark-skinned women

More
Entity

ETS

Incidents involved as both Developer and Deployer
  • Incident 162
    1 Report

    ETS Used Allegedly Flawed Voice Recognition Evidence to Accuse and Assess Scale of Cheating, Causing Thousands to be Deported from the UK

More
Entity

UK ETS past test takers

Incidents Harmed By
  • Incident 162
    1 Report

    ETS Used Allegedly Flawed Voice Recognition Evidence to Accuse and Assess Scale of Cheating, Causing Thousands to be Deported from the UK

More
Entity

UK ETS test takers

Incidents Harmed By
  • Incident 162
    1 Report

    ETS Used Allegedly Flawed Voice Recognition Evidence to Accuse and Assess Scale of Cheating, Causing Thousands to be Deported from the UK

More
Entity

UK Visas and Immigration

Incidents involved as both Developer and Deployer
  • Incident 335
    8 Reports

    UK Visa Streamline Algorithm Allegedly Discriminated Based on Nationality

More
Entity

UK visa applicants from some countries

Incidents Harmed By
  • Incident 335
    8 Reports

    UK Visa Streamline Algorithm Allegedly Discriminated Based on Nationality

More
Entity

UK immigrant newlyweds

Incidents Harmed By
  • Incident 336
    4 Reports

    UK Home Office's Sham Marriage Detection Algorithm Reportedly Flagged Certain Nationalities Disproportionately

More

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2024 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • 1420c8e