Incident 189: Opaque Fraud Detection Algorithm by the UK’s Department of Work and Pensions Allegedly Discriminated against People with Disabilities

Description: People with disabilities were allegedly disproportionately targeted by a benefit fraud detection algorithm which the UK’s Department of Work and Pensions was urged to disclose.

Tools

New ReportNew ReportNew ResponseNew ResponseDiscoverDiscover
Alleged: UiPath developed an AI system deployed by UK Department of Work and Pensions, which harmed people with disabilities.

Incident Stats

Incident ID
189
Report Count
6
Incident Date
2019-10-15
Editors
Sean McGregor, Khoa Lam

Variants

A "variant" is an incident that shares the same causative factors, produces similar harms, and involves the same intelligent systems as a known AI incident. Rather than index variants as entirely separate incidents, we list variations of incidents under the first similar incident submitted to the database. Unlike other submission types to the incident database, variants are not required to have reporting in evidence external to the Incident Database. Learn more from the research paper.