Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Donate
Discover
Submit
  • Welcome to the AIID
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Spatial View
  • Blog
  • AI News Digest
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Spatial View
  • Blog
  • AI News Digest
  • Random Incident
  • Sign Up
Collapse
Entities

People with disabilities

Incidents Harmed By

Incident 1896 Report
Opaque Fraud Detection Algorithm by the UK’s Department of Work and Pensions Allegedly Discriminated against People with Disabilities

2019-10-15

People with disabilities were allegedly disproportionately targeted by a benefit fraud detection algorithm which the UK’s Department of Work and Pensions was urged to disclose.

More

Incident 5023 Report
Pennsylvania County's Family Screening Tool Allegedly Exhibited Discriminatory Effects

2017-04-10

Data analysis by the American Civil Liberty Union (ACLU) on Allegheny County's decision-support Family Screening Tool to predict child abuse or neglect risk found the tool resulting in higher screen-in rates for Black families and higher risk scores for households with disabled residents.

More

Incident 10002 Report
Sora Video Generator Has Reportedly Been Creating Biased Human Representations Across Race, Gender, and Disability

2025-03-23

A WIRED investigation found that OpenAI’s video generation model, Sora, exhibits representational bias across race, gender, body type, and disability. In tests using 250 prompts, Sora was more likely to depict CEOs and professors as men, flight attendants and childcare workers as women, and showed limited or stereotypical portrayals of disabled individuals and people with larger bodies.

More

Incident 6031 Report
Algorithmic Allocation of Resources in Healthcare for Disabled and Elderly Care Services Allegedly Harmed Patients

2021-07-02

A healthcare algorithm designed to equitably distribute caregiving resources is alleged to have drastically cut care hours for the disabled and elderly, purportedly leading to significant hardships and harm. Initially developed for fair resource allocation, the system reportedly faced legal challenges for its inability to accurately assess individual needs, resulting in allegedly reduced essential care.

More

Related Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
 

Entity

UK Department of Work and Pensions

Incidents involved as Deployer
  • Incident 189
    6 Reports

    Opaque Fraud Detection Algorithm by the UK’s Department of Work and Pensions Allegedly Discriminated against People with Disabilities

More
Entity

UiPath

Incidents involved as Developer
  • Incident 189
    6 Reports

    Opaque Fraud Detection Algorithm by the UK’s Department of Work and Pensions Allegedly Discriminated against People with Disabilities

More
Entity

Allegheny County

Incidents involved as Deployer
  • Incident 502
    3 Reports

    Pennsylvania County's Family Screening Tool Allegedly Exhibited Discriminatory Effects

More
Entity

Rhema Vaithianathan

Incidents involved as Developer
  • Incident 502
    3 Reports

    Pennsylvania County's Family Screening Tool Allegedly Exhibited Discriminatory Effects

More
Entity

Emily Putnam-Hornstein

Incidents involved as Developer
  • Incident 502
    3 Reports

    Pennsylvania County's Family Screening Tool Allegedly Exhibited Discriminatory Effects

More
Entity

Centre for Social Data Analytics

Incidents involved as Developer
  • Incident 502
    3 Reports

    Pennsylvania County's Family Screening Tool Allegedly Exhibited Discriminatory Effects

More
Entity

Black families in Allegheny

Incidents Harmed By
  • Incident 502
    3 Reports

    Pennsylvania County's Family Screening Tool Allegedly Exhibited Discriminatory Effects

More
Entity

Hackneys family

Incidents Harmed By
  • Incident 502
    3 Reports

    Pennsylvania County's Family Screening Tool Allegedly Exhibited Discriminatory Effects

More
Entity

Washington DC government

Incidents involved as Deployer
  • Incident 603
    1 Report

    Algorithmic Allocation of Resources in Healthcare for Disabled and Elderly Care Services Allegedly Harmed Patients

More
Entity

State governments

Incidents involved as both Developer and Deployer
  • Incident 603
    1 Report

    Algorithmic Allocation of Resources in Healthcare for Disabled and Elderly Care Services Allegedly Harmed Patients

More
Entity

Pennsylvania state government

Incidents involved as Deployer
  • Incident 603
    1 Report

    Algorithmic Allocation of Resources in Healthcare for Disabled and Elderly Care Services Allegedly Harmed Patients

More
Entity

Missouri state government

Incidents involved as Deployer
  • Incident 603
    1 Report

    Algorithmic Allocation of Resources in Healthcare for Disabled and Elderly Care Services Allegedly Harmed Patients

More
Entity

Iowa state government

Incidents involved as Deployer
  • Incident 603
    1 Report

    Algorithmic Allocation of Resources in Healthcare for Disabled and Elderly Care Services Allegedly Harmed Patients

More
Entity

Idaho state government

Incidents involved as Deployer
  • Incident 603
    1 Report

    Algorithmic Allocation of Resources in Healthcare for Disabled and Elderly Care Services Allegedly Harmed Patients

More
Entity

Arkansas state government

Incidents involved as Deployer
  • Incident 603
    1 Report

    Algorithmic Allocation of Resources in Healthcare for Disabled and Elderly Care Services Allegedly Harmed Patients

More
Entity

Brant Fries

Incidents involved as Developer
  • Incident 603
    1 Report

    Algorithmic Allocation of Resources in Healthcare for Disabled and Elderly Care Services Allegedly Harmed Patients

More
Entity

Tammy Dobbs

Incidents Harmed By
  • Incident 603
    1 Report

    Algorithmic Allocation of Resources in Healthcare for Disabled and Elderly Care Services Allegedly Harmed Patients

More
Entity

Larkin Seiler

Incidents Harmed By
  • Incident 603
    1 Report

    Algorithmic Allocation of Resources in Healthcare for Disabled and Elderly Care Services Allegedly Harmed Patients

More
Entity

Economically vulnerable people

Incidents Harmed By
  • Incident 603
    1 Report

    Algorithmic Allocation of Resources in Healthcare for Disabled and Elderly Care Services Allegedly Harmed Patients

More
Entity

Economically vulnerable patients

Incidents Harmed By
  • Incident 603
    1 Report

    Algorithmic Allocation of Resources in Healthcare for Disabled and Elderly Care Services Allegedly Harmed Patients

More
Entity

Elderly individuals

Incidents Harmed By
  • Incident 603
    1 Report

    Algorithmic Allocation of Resources in Healthcare for Disabled and Elderly Care Services Allegedly Harmed Patients

More
Entity

Algorithmic home care assistance allocation systems

Incidents implicated systems
  • Incident 603
    1 Report

    Algorithmic Allocation of Resources in Healthcare for Disabled and Elderly Care Services Allegedly Harmed Patients

More
Entity

Whisper

Incidents involved as Deployer
  • Incident 732
    1 Report

    Whisper Speech-to-Text AI Reportedly Found to Create Violent Hallucinations

Incidents implicated systems
  • Incident 732
    1 Report

    Whisper Speech-to-Text AI Reportedly Found to Create Violent Hallucinations

More
Entity

Organizations integrating Whisper into customer service systems

Incidents involved as Deployer
  • Incident 732
    1 Report

    Whisper Speech-to-Text AI Reportedly Found to Create Violent Hallucinations

More
Entity

OpenAI

Incidents involved as both Developer and Deployer
  • Incident 1000
    2 Reports

    Sora Video Generator Has Reportedly Been Creating Biased Human Representations Across Race, Gender, and Disability

  • Incident 732
    1 Report

    Whisper Speech-to-Text AI Reportedly Found to Create Violent Hallucinations

More
Entity

Companies using Whisper

Incidents involved as Deployer
  • Incident 732
    1 Report

    Whisper Speech-to-Text AI Reportedly Found to Create Violent Hallucinations

More
Entity

Whisper users

Incidents involved as Deployer
  • Incident 732
    1 Report

    Whisper Speech-to-Text AI Reportedly Found to Create Violent Hallucinations

More
Entity

Users whose speech is misinterpreted by Whisper

Incidents Harmed By
  • Incident 732
    1 Report

    Whisper Speech-to-Text AI Reportedly Found to Create Violent Hallucinations

More
Entity

Professionals relying on accurate transcriptions

Incidents Harmed By
  • Incident 732
    1 Report

    Whisper Speech-to-Text AI Reportedly Found to Create Violent Hallucinations

More
Entity

Individuals with speech impairments

Incidents Harmed By
  • Incident 732
    1 Report

    Whisper Speech-to-Text AI Reportedly Found to Create Violent Hallucinations

More
Entity

General public

Incidents Harmed By
  • Incident 1000
    2 Reports

    Sora Video Generator Has Reportedly Been Creating Biased Human Representations Across Race, Gender, and Disability

  • Incident 732
    1 Report

    Whisper Speech-to-Text AI Reportedly Found to Create Violent Hallucinations

More
Entity

Marginalized groups

Incidents Harmed By
  • Incident 1000
    2 Reports

    Sora Video Generator Has Reportedly Been Creating Biased Human Representations Across Race, Gender, and Disability

More
Entity

Women

Incidents Harmed By
  • Incident 1000
    2 Reports

    Sora Video Generator Has Reportedly Been Creating Biased Human Representations Across Race, Gender, and Disability

More
Entity

People with larger bodies

Incidents Harmed By
  • Incident 1000
    2 Reports

    Sora Video Generator Has Reportedly Been Creating Biased Human Representations Across Race, Gender, and Disability

More
Entity

LGBTQ+ people

Incidents Harmed By
  • Incident 1000
    2 Reports

    Sora Video Generator Has Reportedly Been Creating Biased Human Representations Across Race, Gender, and Disability

More
Entity

People of color

Incidents Harmed By
  • Incident 1000
    2 Reports

    Sora Video Generator Has Reportedly Been Creating Biased Human Representations Across Race, Gender, and Disability

More
Entity

Sora

Incidents implicated systems
  • Incident 1000
    2 Reports

    Sora Video Generator Has Reportedly Been Creating Biased Human Representations Across Race, Gender, and Disability

More

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2026 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • 18fcd27