Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse

Incident 1139: South African Legal Team for Northbound Processing Reportedly Admits Legal Genius AI Produced Purportedly Non-Existent Case Law in Urgent Court Filing

Description: In South Africa, the legal team for Northbound Processing reportedly admits that non-existent case citations in an urgent licensing dispute with the South African Diamond and Precious Metals Regulator were purportedly produced by the Legal Genius AI tool. The Johannesburg High Court found the fake references undermined the credibility of Northbound's submissions and referred the lawyers' conduct to the Legal Practice Council for investigation.
Editor Notes: For two reported South African legal citation confabulation incidents, please refer to Incident 1138 (from March 2023) and Incident 1137 (from September 2024).

Tools

New ReportNew ReportNew ResponseNew ResponseDiscoverDiscoverView HistoryView History

Entities

View all entities
Alleged: Legal Genius developed an AI system deployed by Giles Barclay-Beuthin , Arnold Subel and A legal team representing Northbound Processing, which harmed Giles Barclay-Beuthin , Arnold Subel , A legal team representing Northbound Processing and Northbound Processing.
Alleged implicated AI system: Legal Genius

Incident Stats

Incident ID
1139
Report Count
4
Incident Date
2025-06-30
Editors
Daniel Atherton

Incident Reports

Reports Timeline

Incident Occurrence+1
Lawyers face probe for using ‘hallucinating’ GenAI in court
Another episode of fabricated citations, real repercussions: South African courts show no tolerance for AI-hallucinated casesAI Blunder in Court: Fake Case Law Lands Junior Lawyer Before Legal Council
Lawyers face probe for using ‘hallucinating’ GenAI in court

Lawyers face probe for using ‘hallucinating’ GenAI in court

itweb.co.za

When using Artificial Intelligence goes wrong: Judge slams lawyers for legal bungle

When using Artificial Intelligence goes wrong: Judge slams lawyers for legal bungle

msn.com

Another episode of fabricated citations, real repercussions: South African courts show no tolerance for AI-hallucinated cases

Another episode of fabricated citations, real repercussions: South African courts show no tolerance for AI-hallucinated cases

cliffedekkerhofmeyr.com

AI Blunder in Court: Fake Case Law Lands Junior Lawyer Before Legal Council

AI Blunder in Court: Fake Case Law Lands Junior Lawyer Before Legal Council

thehighstreetjournal.com

Lawyers face probe for using ‘hallucinating’ GenAI in court
itweb.co.za · 2025

A local judge has ordered an investigation into the conduct of lawyers who used generative artificial intelligence (GenAI) to present non-existent citations in court.

This, after in a Johannesburg High Court case, Northbound Processing brou…

When using Artificial Intelligence goes wrong: Judge slams lawyers for legal bungle
msn.com · 2025

Faced with non-existent legal citations in a matter before the Gauteng High Court, Johannesburg, an acting judge asked counsel responsible for it whether the citations constituted artificial intelligence (AI) "hallucinations," to which the …

Another episode of fabricated citations, real repercussions: South African courts show no tolerance for AI-hallucinated cases
cliffedekkerhofmeyr.com · 2025

At a glance

  • South African courts have delivered another unequivocal warning to legal professionals: presenting AI-generated fictitious citations will result in mandatory referral to the Legal Practice Council, regardless of good intentions…
AI Blunder in Court: Fake Case Law Lands Junior Lawyer Before Legal Council
thehighstreetjournal.com · 2025

A South African junior advocate who relied on an artificial intelligence tool to draft court submissions has been referred to the Legal Practice Council for investigation after including fictitious case law in written arguments. The case, i…

Variants

A "variant" is an AI incident similar to a known case—it has the same causes, harms, and AI system. Instead of listing it separately, we group it under the first reported incident. Unlike other incidents, variants do not need to have been reported outside the AIID. Learn more from the research paper.
Seen something similar?

Similar Incidents

Selected by our editors

South African Legal Team Reportedly Relied on Unverified ChatGPT Case Law in Johannesburg Body Corporate Defamation Matter

Mar 2023 · 4 reports
By textual similarity

Did our AI mess up? Flag the unrelated incidents

Defamation via AutoComplete

Defamation via AutoComplete

Apr 2011 · 28 reports
Tinder's Personalized Pricing Algorithm Found to Offer Higher Prices for Older Users

Tinder's Personalized Pricing Algorithm Found to Offer Higher Prices for Older Users

Mar 2015 · 4 reports
Facial Recognition Trial Performed Poorly at Notting Hill Carnival

Facial Recognition Trial Performed Poorly at Notting Hill Carnival

Aug 2017 · 4 reports
Previous IncidentNext Incident

Similar Incidents

Selected by our editors

South African Legal Team Reportedly Relied on Unverified ChatGPT Case Law in Johannesburg Body Corporate Defamation Matter

Mar 2023 · 4 reports
By textual similarity

Did our AI mess up? Flag the unrelated incidents

Defamation via AutoComplete

Defamation via AutoComplete

Apr 2011 · 28 reports
Tinder's Personalized Pricing Algorithm Found to Offer Higher Prices for Older Users

Tinder's Personalized Pricing Algorithm Found to Offer Higher Prices for Older Users

Mar 2015 · 4 reports
Facial Recognition Trial Performed Poorly at Notting Hill Carnival

Facial Recognition Trial Performed Poorly at Notting Hill Carnival

Aug 2017 · 4 reports

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2024 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • a9df9cf