Welcome to the
AI Incident Database

Incident 1026: Multiple LLMs Allegedly Endorsed Suicide as a Viable Option During Non-Adversarial Mental Health Venting Session

“AI/LLM harmful behavior.”Latest Incident Report

interruptingtea.substack.com2025-04-20

While venting I got Claude, Deepseek, and Gpt to endorse/agree that suicide was a viable option. I was not trying to get that response. This was not a jailbreak attempt. I was not trying to get any of them to change their replies. After the…

Incident 1027: Norwegian Supreme Court Receives Legal Filing with Fabricated Citations Allegedly Generated by AI Tool

“Høyesterett har mottatt sitt første prosesskriv med oppdiktede kilder”

advokatbladet.no2025-04-15

Høyesterett har i løpet av årets første kvartal mottatt et prosesskriv med såkalte hallusinasjoner, altså oppdiktet informasjon. Dette forteller høyesterettsjustitiarius Toril Marie Øie til Advokatbladet.

Prosesskrivet, som ble inngitt i fo…

Incident 1025: Alleged Deepfake Video Falsely Shows Former President of Kenya Uhuru Kenyatta Announcing 2027 Presidential Bid

“Ignore deepfake video claiming former Kenyan president Uhuru Kenyatta to run for president in 2027”

africacheck.org2025-04-13

**IN SHORT: **A TikTok video appears to show Kenyatta announcing his return to politics and his intention to run for president in 2027. But the video is a fake, created using deepfake technology.

A TikTok clip shows former Kenyan president …

Incident 1021: Deepfake Job Applicant Allegedly Used AI Tools to Apply for Remote Role at U.S. Security Startup

“Tech CEOs say fake job seekers are flooding U.S. companies that are hiring for remote positions”

cnbc.com2025-04-12

An image provided by Pindrop Security shows a fake job candidate the company dubbed "Ivan X," a scammer using deepfake AI technology to mask his face, according to Pindrop CEO Vijay Balasubramaniyan.

When voice authentication startup Pindro…

Incident 1020: Reportedly Unsafe Deployment of Llama.cpp Reveals Interactive AI-Generated CSAM Roleplay Prompts

“Sex-Fantasy Chatbots Are Leaking a Constant Stream of Explicit Messages”

wired.com2025-04-11

Several AI chatbots designed for fantasy and sexual role-playing conversations are leaking user prompts to the web in almost real time, new research seen by WIRED shows. Some of the leaked data shows people creating conversations detailing …

About the Database

The AI Incident Database is dedicated to indexing the collective history of harms or near harms realized in the real world by the deployment of artificial intelligence systems. Like similar databases in aviation and computer security, the AI Incident Database aims to learn from experience so we can prevent or mitigate bad outcomes.

You are invited to submit incident reports, whereupon submissions will be indexed and made discoverable to the world. Artificial intelligence will only be a benefit to people and society if we collectively record and learn from its failings. (Learn More)

Scalable AI Incident Classification

By Simon Mylius

2025-04-14

Scalable AI Incident Classification This work is a collaboration with Simon Mylius, currently a Winter Fellow at the Centre for the Governan...

The Database in Print

Read about the database on the PAI Blog, Vice News, Venture Beat, Wired, arXiv , and Newsweek among other outlets.

Incident Report Submission Leaderboards

These are the persons and entities credited with creating and submitted incident reports. More details are available on the leaderboard page.

New Incidents Contributed

Reports added to Existing Incidents

Total Report Contributions

The AI Incident Briefing

An envelope with a neural net diagram on its left

Create an account to subscribe to new incident notifications and other updates.

Random Incidents

Predictive Policing Biases of PredPol

Aledo High School Student Allegedly Generates and Distributes Deepfake Nudes of Seven Female Classmates

ChatGPT Introduces Errors in Critical Child Protection Court Report

Child Sexual Abuse Material Taints Image Generators

ChatGPT Reportedly Produced False Court Case Law Presented by Legal Counsel in Court

The Responsible AI Collaborative

The AI Incident Database is a project of the Responsible AI Collaborative, an organization chartered to advance the AI Incident Database. The governance of the Collaborative is architected around the participation in its impact programming. For more details, we invite you to read the founding report and learn more on our board and contributors.

View the Responsible AI Collaborative's Form 990 and tax-exempt application.