Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Donate
Discover
Submit
  • Welcome to the AIID
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Spatial View
  • Blog
  • AI News Digest
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Spatial View
  • Blog
  • AI News Digest
  • Random Incident
  • Sign Up
Collapse
Entities

Department for Work and Pensions

Incidents involved as both Developer and Deployer

Incident 61113 Report
UK Government AI Allegedly Targets Disproportionate Numbers of Certain Nationals for Fraud Review

2021-12-06

The UK's Department for Work and Pensions (DWP) faced scrutiny after many Bulgarian nationals reported unexplained suspensions of their Universal Credit benefits. The MP for Edmonton raised concerns about potential nationality-based targeting for benefit fraud investigations, leading to poverty and homelessness among affected individuals. The Home Office's own equality impact assessment found it was flagging a disproportionate number of marriages from Greece, Albania, Bulgaria and Romania.

More

Incident 7385 Report
Department for Work and Pensions (DWP) Algorithm Wrongly Flags 200,000 for Housing Benefit Fraud

2024-06-23

A Department for Work and Pensions (DWP) algorithm wrongly flagged over 200,000 UK housing benefit claims as high risk, resulting in unnecessary investigations. Two-thirds of these flagged claims were legitimate, causing wasted public funds and stress for claimants. Despite initial success in a pilot, the algorithm's real-world performance fell short. This incident highlights the risks of overreliance on automated systems in welfare administration.

More

Incident 7401 Report
Department for Work and Pensions (DWP) AI Systems Allegedly Discriminate Against Single Mothers

2024-07-10

Researchers have argued that the Department for Work and Pensions' Universal Credit system disproportionately impacts single mothers. Automated processes in the system, designed to determine eligibility and detect fraud, are reported to have introduced biases, leading to financial instability and hardship. The algorithms allegedly miscalculate earnings and delay childcare reimbursements, in turn exacerbating income volatility and debt among single mothers.

More

Related Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
 

Entity

Various British government offices

Incidents involved as Deployer
  • Incident 611
    13 Reports

    UK Government AI Allegedly Targets Disproportionate Numbers of Certain Nationals for Fraud Review

More
Entity

Home Office

Incidents involved as both Developer and Deployer
  • Incident 611
    13 Reports

    UK Government AI Allegedly Targets Disproportionate Numbers of Certain Nationals for Fraud Review

More
Entity

British government

Incidents involved as both Developer and Deployer
  • Incident 611
    13 Reports

    UK Government AI Allegedly Targets Disproportionate Numbers of Certain Nationals for Fraud Review

More
Entity

Romanians in the United Kingdom

Incidents Harmed By
  • Incident 611
    13 Reports

    UK Government AI Allegedly Targets Disproportionate Numbers of Certain Nationals for Fraud Review

More
Entity

Greeks in the United Kingdom

Incidents Harmed By
  • Incident 611
    13 Reports

    UK Government AI Allegedly Targets Disproportionate Numbers of Certain Nationals for Fraud Review

More
Entity

Bulgarians in the United Kingdom

Incidents Harmed By
  • Incident 611
    13 Reports

    UK Government AI Allegedly Targets Disproportionate Numbers of Certain Nationals for Fraud Review

More
Entity

British public

Incidents Harmed By
  • Incident 611
    13 Reports

    UK Government AI Allegedly Targets Disproportionate Numbers of Certain Nationals for Fraud Review

More
Entity

Albanians in the United Kingdom

Incidents Harmed By
  • Incident 611
    13 Reports

    UK Government AI Allegedly Targets Disproportionate Numbers of Certain Nationals for Fraud Review

More
Entity

UK general public

Incidents Harmed By
  • Incident 738
    5 Reports

    Department for Work and Pensions (DWP) Algorithm Wrongly Flags 200,000 for Housing Benefit Fraud

More
Entity

UK housing benefit claimants

Incidents Harmed By
  • Incident 738
    5 Reports

    Department for Work and Pensions (DWP) Algorithm Wrongly Flags 200,000 for Housing Benefit Fraud

More
Entity

Single mothers

Incidents Harmed By
  • Incident 740
    1 Report

    Department for Work and Pensions (DWP) AI Systems Allegedly Discriminate Against Single Mothers

More
Entity

British single mothers

Incidents Harmed By
  • Incident 740
    1 Report

    Department for Work and Pensions (DWP) AI Systems Allegedly Discriminate Against Single Mothers

More

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2026 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • 18fcd27