Welcome to the
AI Incident Database

Incident 1136: Purported Widespread Use of AI-Generated Deepfake Videos Impersonate Malaysian Leaders in Investment Scams

“AI deepfakes of PM, tycoons used in scams”Latest Incident Report

nst.com.my2025-07-05

KUALA LUMPUR: Scammers are using artificial intelligence (AI) to create hyper-realistic videos featuring politicians, business moguls, and celebrities.

These videos are used to lure unsuspecting people into fraudulent investment schemes.

MC…

Incident 1137: Reported False Legal Citations in South African Case Mavundla v. MEC Generated by Purported AI Tool

“Pietermaritzburg law firm under fire for “non-existent” case studies”

iol.co.za2025-07-05

A Pietermaritzburg law firm has come under fire after apparently using “non-existent” case studies generated from an Artificial Intelligence (AI) application in court proceedings.

This was heard during the handing down of judgment in a leav…

Incident 1138: Rodrigues Blignaut Attorneys Reportedly Relied on Unverified ChatGPT Case Law in Johannesburg Body Corporate Defamation Matter

“Magistrate rebukes lawyers over ChatGPT 'bogus cases'”

timeslive.co.za2025-07-05

Lawyers acting for a woman who claimed she was defamed by a body corporate in Parkwood, Johannesburg, were left red-faced when it emerged they tried to use non-existent judgments generated by ChatGPT to bolster her case.

“The names and cita…

Incident 1139: South African Legal Team for Northbound Processing Reportedly Admits Legal Genius AI Produced Purportedly Non-Existent Case Law in Urgent Court Filing

“Lawyers face probe for using ‘hallucinating’ GenAI in court”

itweb.co.za2025-07-05

A local judge has ordered an investigation into the conduct of lawyers who used generative artificial intelligence (GenAI) to present non-existent citations in court.

This, after in a Johannesburg High Court case, Northbound Processing brou…

Incident 1135: Preprints Reportedly from Researchers from Multiple Universities Allegedly Contain Covert AI Prompts

“'Positive review only': Researchers hide AI prompts in papers”

asia.nikkei.com2025-07-04

TOKYO -- Research papers from 14 academic institutions in eight countries -- including Japan, South Korea and China -- contained hidden prompts directing artificial intelligence tools to give them good reviews, Nikkei has found.

Nikkei look…

About the Database

The AI Incident Database is dedicated to indexing the collective history of harms or near harms realized in the real world by the deployment of artificial intelligence systems. Like similar databases in aviation and computer security, the AI Incident Database aims to learn from experience so we can prevent or mitigate bad outcomes.

You are invited to submit incident reports, whereupon submissions will be indexed and made discoverable to the world. Artificial intelligence will only be a benefit to people and society if we collectively record and learn from its failings. (Learn More)

AI Incident Roundup – April and May 2025

By Daniel Atherton

2025-06-16

Our review newsletter recapping new incident IDs in the AI Incident Database and looking at the trends. 🗄 Trending in the AIID Across April ...

The Database in Print

Read about the database on the PAI Blog, Vice News, Venture Beat, Wired, arXiv , and Newsweek among other outlets.

Incident Report Submission Leaderboards

These are the persons and entities credited with creating and submitted incident reports. More details are available on the leaderboard page.

New Incidents Contributed

Reports added to Existing Incidents

Total Report Contributions

The AI Incident Briefing

An envelope with a neural net diagram on its left

Create an account to subscribe to new incident notifications and other updates.

Random Incidents

Predictive Policing Biases of PredPol

Aledo High School Student Allegedly Generates and Distributes Deepfake Nudes of Seven Female Classmates

ChatGPT Introduces Errors in Critical Child Protection Court Report

Child Sexual Abuse Material Taints Image Generators

ChatGPT Reportedly Produced False Court Case Law Presented by Legal Counsel in Court

The Responsible AI Collaborative

The AI Incident Database is a project of the Responsible AI Collaborative, an organization chartered to advance the AI Incident Database. The governance of the Collaborative is architected around the participation in its impact programming. For more details, we invite you to read the founding report and learn more on our board and contributors.

View the Responsible AI Collaborative's Form 990 and tax-exempt application.