Welcome to the
AI Incident Database

Incident 1067: Alleged Use of Purported AI-Generated Identities to Defraud FTX Claims Buyers of $5.6M

“AI Deepfake Scam Steals $5.6 in Fake FTX Claims Fraud”Latest Incident Report

tokenpost.com2025-05-17

A sophisticated fraud scheme involving deepfake technology has led to the theft of at least $5.6 million from companies purchasing fake FTX liquidation claims, according to Inca Digital. The scam, uncovered ahead of FTX’s scheduled payouts …

Incident 1068: AI-Powered Presentation Tool Gamma Implicated in Multi-Stage Phishing Campaign

“AI-Powered Presentation Tool Leveraged in Phishing Attacks”

darkreading.com2025-05-17

An AI-powered presentation tool named Gamma is being used in phishing attacks to trick targets into thinking an email is legitimate.

That's according to researchers at security vendor Abnormal Security, which published research today dedica…

Incident 1069: Purported Graphite Spyware Linked to Paragon Solutions Allegedly Deployed Against Journalists and Civil Society Workers

“Nation-State 'Paragon' Spyware Infections Target Civil Society”

darkreading.com2025-05-17

Researchers are beginning to unravel global surveillance operations targeting journalists, humanitarian aid workers, and other civilians via messaging apps.

On Jan. 31, WhatsApp contacted more than 90 individuals whom it believed had been t…

Incident 1070: Serviceaide AI Platform Implicated in Health Data Exposure Affecting 483,000 Catholic Health Patients

“Agentic AI Tech Firm Says Health Data Leak Affects 483,000”

bankinfosecurity.com2025-05-17

Serviceaide, a provider of agentic artificial intelligence-based IT management and workflow software, reported to regulators that an inadvertent exposure of data on the web has affected more than 483,000 patients of client Catholic Health, …

Incident 1072: Grok Chatbot Reportedly Inserted Content About South Africa and 'White Genocide' in Unrelated User Queries

“Elon Musk’s Grok AI Can’t Stop Talking About ‘White Genocide’”

wired.com2025-05-17

A chatbot developed by Elon Musk's multibillion-dollar artificial intelligence startup xAI appeared to be suffering from a glitch Wednesday when it repeatedly brought up white genocide in South Africa in response to user queries about unrel…

About the Database

The AI Incident Database is dedicated to indexing the collective history of harms or near harms realized in the real world by the deployment of artificial intelligence systems. Like similar databases in aviation and computer security, the AI Incident Database aims to learn from experience so we can prevent or mitigate bad outcomes.

You are invited to submit incident reports, whereupon submissions will be indexed and made discoverable to the world. Artificial intelligence will only be a benefit to people and society if we collectively record and learn from its failings. (Learn More)

Scalable AI Incident Classification

By Simon Mylius

2025-04-14

Scalable AI Incident Classification This work is a collaboration with Simon Mylius, currently a Winter Fellow at the Centre for the Governan...

The Database in Print

Read about the database on the PAI Blog, Vice News, Venture Beat, Wired, arXiv , and Newsweek among other outlets.

Incident Report Submission Leaderboards

These are the persons and entities credited with creating and submitted incident reports. More details are available on the leaderboard page.

New Incidents Contributed

Reports added to Existing Incidents

Total Report Contributions

The AI Incident Briefing

An envelope with a neural net diagram on its left

Create an account to subscribe to new incident notifications and other updates.

Random Incidents

Predictive Policing Biases of PredPol

Aledo High School Student Allegedly Generates and Distributes Deepfake Nudes of Seven Female Classmates

ChatGPT Introduces Errors in Critical Child Protection Court Report

Child Sexual Abuse Material Taints Image Generators

ChatGPT Reportedly Produced False Court Case Law Presented by Legal Counsel in Court

The Responsible AI Collaborative

The AI Incident Database is a project of the Responsible AI Collaborative, an organization chartered to advance the AI Incident Database. The governance of the Collaborative is architected around the participation in its impact programming. For more details, we invite you to read the founding report and learn more on our board and contributors.

View the Responsible AI Collaborative's Form 990 and tax-exempt application.