Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
発見する
投稿する
  • ようこそAIIDへ
  • インシデントを発見
  • 空間ビュー
  • テーブル表示
  • リスト表示
  • 組織
  • 分類法
  • インシデントレポートを投稿
  • 投稿ランキング
  • ブログ
  • AIニュースダイジェスト
  • リスクチェックリスト
  • おまかせ表示
  • サインアップ
閉じる
発見する
投稿する
  • ようこそAIIDへ
  • インシデントを発見
  • 空間ビュー
  • テーブル表示
  • リスト表示
  • 組織
  • 分類法
  • インシデントレポートを投稿
  • 投稿ランキング
  • ブログ
  • AIニュースダイジェスト
  • リスクチェックリスト
  • おまかせ表示
  • サインアップ
閉じる

インシデント 611: UK Government AI Allegedly Targets Disproportionate Numbers of Certain Nationals for Fraud Review

概要: The UK's Department for Work and Pensions (DWP) faced scrutiny after many Bulgarian nationals reported unexplained suspensions of their Universal Credit benefits. The MP for Edmonton raised concerns about potential nationality-based targeting for benefit fraud investigations, leading to poverty and homelessness among affected individuals. The Home Office's own equality impact assessment found it was flagging a disproportionate number of marriages from Greece, Albania, Bulgaria and Romania.

ツール

新しいレポート新しいレポート新しいレスポンス新しいレスポンス発見する発見する履歴を表示履歴を表示

組織

すべての組織を表示
Alleged: Home Office , Department for Work and Pensions と British government developed an AI system deployed by Various British government offices , Home Office , Department for Work and Pensions と British government, which harmed Romanians in the United Kingdom , Greeks in the United Kingdom , Bulgarians in the United Kingdom , British public と Albanians in the United Kingdom.

インシデントのステータス

インシデントID
611
レポート数
13
インシデント発生日
2021-12-06
エディタ
Daniel Atherton
Applied Taxonomies
MIT

MIT 分類法のクラス

Machine-Classified
分類法の詳細

Risk Subdomain

A further 23 subdomains create an accessible and understandable classification of hazards and harms associated with AI
 

1.1. Unfair discrimination and misrepresentation

Risk Domain

The Domain Taxonomy of AI Risks classifies risks into seven AI risk domains: (1) Discrimination & toxicity, (2) Privacy & security, (3) Misinformation, (4) Malicious actors & misuse, (5) Human-computer interaction, (6) Socioeconomic & environmental harms, and (7) AI system safety, failures & limitations.
 
  1. Discrimination and Toxicity

Entity

Which, if any, entity is presented as the main cause of the risk
 

Human

Timing

The stage in the AI lifecycle at which the risk is presented as occurring
 

Post-deployment

Intent

Whether the risk is presented as occurring as an expected or unexpected outcome from pursuing a goal
 

Intentional

インシデントレポート

レポートタイムライン

+1
MP raises concern over Bulgarian nationals’ UK benefit suspensions
+3
DWP ramps up investment in AI models to detect fraud despite algorithmic bias concerns
UK warned over lack of transparency on use of AI to vet welfare claims+6
DWP’s fraud and error checking AI still displaying signs of bias
MP raises concern over Bulgarian nationals’ UK benefit suspensions

MP raises concern over Bulgarian nationals’ UK benefit suspensions

theguardian.com

DWP ramps up investment in AI models to detect fraud despite algorithmic bias concerns

DWP ramps up investment in AI models to detect fraud despite algorithmic bias concerns

techmonitor.ai

AI use widened to assess universal credit applications and tackle fraud

AI use widened to assess universal credit applications and tackle fraud

theguardian.com

Universal Credit: Warnings over AI use to risk-score benefit claims

Universal Credit: Warnings over AI use to risk-score benefit claims

bbc.com

DWP Widening Use of Anti-fraud Tech Amid Concerns From Campaign Groups

DWP Widening Use of Anti-fraud Tech Amid Concerns From Campaign Groups

digit.fyi

UK warned over lack of transparency on use of AI to vet welfare claims

UK warned over lack of transparency on use of AI to vet welfare claims

theguardian.com

DWP’s fraud and error checking AI still displaying signs of bias

DWP’s fraud and error checking AI still displaying signs of bias

techmonitor.ai

UK risks scandal over ‘bias’ in AI tools in use across public sector

UK risks scandal over ‘bias’ in AI tools in use across public sector

theguardian.com

AI employed for crucial decisions in over 8 Whitehall departments

AI employed for crucial decisions in over 8 Whitehall departments

interestingengineering.com

UK govt using AI to decide benefits for people, marriage licenses: Report

UK govt using AI to decide benefits for people, marriage licenses: Report

hindustantimes.com

Revealed: Government using AI to decide on benefits and driving licences

Revealed: Government using AI to decide on benefits and driving licences

independent.co.uk

UK government using AI to decide benefit payments and spot sham marriages, investigation reveals

UK government using AI to decide benefit payments and spot sham marriages, investigation reveals

uk.news.yahoo.com

Decisions on benefits and migrants ‘being made by AI’

Decisions on benefits and migrants ‘being made by AI’

thetimes.co.uk

MP raises concern over Bulgarian nationals’ UK benefit suspensions
theguardian.com · 2021

Dozens of Bulgarian nationals have been tipped into poverty after unexplained benefit suspensions following the creation of a “risk review” unit in the Department for Work and Pensions, an MP has said.

Kate Osamor, the Labour MP for Edmonto…

DWP ramps up investment in AI models to detect fraud despite algorithmic bias concerns
techmonitor.ai · 2023

The Department for Work and Pensions (DWP) is ploughing £70m into its digital transformation projects over the next three years. However, the National Audit Office (NAO) has raised concerns about investments the department is making in arti…

AI use widened to assess universal credit applications and tackle fraud
theguardian.com · 2023

The government has widened its deployment of artificial intelligence to uncover welfare fraud, despite warnings of algorithmic bias against groups of vulnerable claimants.

In a £70m investment applying “advanced analytics” to requests for u…

Universal Credit: Warnings over AI use to risk-score benefit claims
bbc.com · 2023

The Department of Work and Pensions (DWP) has revealed plans to widen its use of the technology to tackle fraud.

Campaigners say more information is needed to ensure the system does not make biased referrals for benefit investigations.

The …

DWP Widening Use of Anti-fraud Tech Amid Concerns From Campaign Groups
digit.fyi · 2023

In a recent National Audit Office (NAO) report concerning the Department for Work and Pensions (DWP) financial accounts, it has come to light that the DWP is expanding its use of machine learning for identifying potential benefits fraud.

Si…

UK warned over lack of transparency on use of AI to vet welfare claims
theguardian.com · 2023

The UK government risks contempt of court unless it improves its response to requests for transparency over the use of artificial intelligence (AI) to vet welfare claims, the information commissioner has said.

Over the past two years, the D…

DWP’s fraud and error checking AI still displaying signs of bias
techmonitor.ai · 2023

Senior civil servants told a committee of MPs that an AI being developed by the Department for Work and Pensions (DWP) to detect fraud and error is still in the learning stages of its development and is exhibiting bias against some claimant…

UK risks scandal over ‘bias’ in AI tools in use across public sector
theguardian.com · 2023

Kate Osamor, the Labour MP for Edmonton, recently received an email from a charity about a constituent of hers who had had her benefits suspended apparently without reason.

“For well over a year now she has been trying to contact DWP [the D…

AI employed for crucial decisions in over 8 Whitehall departments
interestingengineering.com · 2023

In the past, artificial intelligence (AI) use in public services has caused uproars. For instance, in the Netherlands, tax authorities used technology to find fraud but made many mistakes. This resulted in a hefty fine of €3.7m, pushing tho…

UK govt using AI to decide benefits for people, marriage licenses: Report
hindustantimes.com · 2023

The report made findings of some potentially discriminatory results made by the artificial intelligence.

The UK government officials are using artificial intelligence (AI) and complex algorithms to help make various decisions including thos…

Revealed: Government using AI to decide on benefits and driving licences
independent.co.uk · 2023

Government officials are using artificial intelligence (AI) to help decide on everything from approving marriage licences to who should be given benefits, it has been revealed.

Civil servants in at least eight Whitehall departments, and sev…

UK government using AI to decide benefit payments and spot sham marriages, investigation reveals
uk.news.yahoo.com · 2023

The government's use of artificial intelligence (AI) risks producing discriminatory results against benefit claimants and ethnic minorities, an investigation has found.

A total of eight Whitehall departments and some police forces are using…

Decisions on benefits and migrants ‘being made by AI’
thetimes.co.uk · 2023

Civil servants in at least eight government departments and the police are using artificial intelligence to make decisions on welfare, immigration and criminal justice, it has been claimed.

The Guardian reported that the systems were being …

バリアント

「バリアント」は既存のAIインシデントと同じ原因要素を共有し、同様な被害を引き起こし、同じ知的システムを含んだインシデントです。バリアントは完全に独立したインシデントとしてインデックスするのではなく、データベースに最初に投稿された同様なインシデントの元にインシデントのバリエーションとして一覧します。インシデントデータベースの他の投稿タイプとは違い、バリアントではインシデントデータベース以外の根拠のレポートは要求されません。詳細についてはこの研究論文を参照してください

よく似たインシデント

Selected by our editors
Department for Work and Pensions (DWP) Algorithm Wrongly Flags 200,000 for Housing Benefit Fraud

DWP algorithm wrongly flags 200,000 people for possible fraud and error

Jun 2024 · 5 レポート
テキスト類似度による

Did our AI mess up? Flag the unrelated incidents

Opaque Fraud Detection Algorithm by the UK’s Department of Work and Pensions Allegedly Discriminated against People with Disabilities

DWP urged to reveal algorithm that ‘targets’ disabled for benefit fraud

Oct 2019 · 6 レポート
Australian Automated Debt Assessment System Issued False Notices to Thousands

Centrelink's debt recovery system lacks transparency and treated some customers unfairly, ombudsman finds

Jul 2015 · 39 レポート
Airbnb's Trustworthiness Algorithm Allegedly Banned Users without Explanation, and Discriminated against Sex Workers

Is Airbnb using an algorithm to ban users from the platform?

Jul 2017 · 6 レポート
前のインシデント次のインシデント

よく似たインシデント

Selected by our editors
Department for Work and Pensions (DWP) Algorithm Wrongly Flags 200,000 for Housing Benefit Fraud

DWP algorithm wrongly flags 200,000 people for possible fraud and error

Jun 2024 · 5 レポート
テキスト類似度による

Did our AI mess up? Flag the unrelated incidents

Opaque Fraud Detection Algorithm by the UK’s Department of Work and Pensions Allegedly Discriminated against People with Disabilities

DWP urged to reveal algorithm that ‘targets’ disabled for benefit fraud

Oct 2019 · 6 レポート
Australian Automated Debt Assessment System Issued False Notices to Thousands

Centrelink's debt recovery system lacks transparency and treated some customers unfairly, ombudsman finds

Jul 2015 · 39 レポート
Airbnb's Trustworthiness Algorithm Allegedly Banned Users without Explanation, and Discriminated against Sex Workers

Is Airbnb using an algorithm to ban users from the platform?

Jul 2017 · 6 レポート

リサーチ

  • “AIインシデント”の定義
  • “AIインシデントレスポンス”の定義
  • データベースのロードマップ
  • 関連研究
  • 全データベースのダウンロード

プロジェクトとコミュニティ

  • AIIDについて
  • コンタクトとフォロー
  • アプリと要約
  • エディタのためのガイド

インシデント

  • 全インシデントの一覧
  • フラグの立ったインシデント
  • 登録待ち一覧
  • クラスごとの表示
  • 分類法

2024 - AI Incident Database

  • 利用規約
  • プライバシーポリシー
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • ecd56df