Legal professionals
Affecté par des incidents
Incident 7042 Rapports
Study Highlights Persistent Hallucinations in Legal AI Systems
2024-05-23
Stanford University’s Human-Centered AI Institute (HAI) conducted a study in which they designed a "pre-registered dataset of over 200 open-ended legal queries" to test AI products by LexisNexis (creator of Lexis+ AI) and Thomson Reuters (creator of Westlaw AI-Assisted Research and Ask Practical Law AI). The researchers found that these legal models hallucinate in 1 out of 6 (or more) benchmarking queries.
PlusIncidents involved as Deployer
Incident 16583 Rapports
State Farm Defense Counsel Acknowledged AI-Assisted Filings in Meni-Siliga v. A's Contractor, Inc. Contained Fabricated Legal Authorities
2026-03-31
In Fa'alagilagi Meni-Siliga v. A's Contractor, Inc., et al., attorneys representing State Farm acknowledged that AI-assisted motions contained fabricated and otherwise inaccurate legal authorities. Attorney Jacquelene Robinson said she used the legal AI tool Irys and failed to verify some citations. Opposing counsel identified the errors, after which the firm apologized and filed corrected versions.
PlusIncident 17243 Rapports
Oklahoma Judge Reportedly Used ChatGPT-Generated Fictitious Case Citations in Family-Law Order
2025-11-19
Stephens County, Oklahoma, Associate District Judge Lawrence Wheeler reportedly used ChatGPT for legal research while preparing a family-law order that cited at least two nonexistent cases. The order denied a request for a psychological evaluation and reprimanded the requesting attorney; Wheeler later vacated it after the attorney challenged it before the Oklahoma Supreme Court.
PlusIncident 7042 Rapports
Study Highlights Persistent Hallucinations in Legal AI Systems
2024-05-23
Stanford University’s Human-Centered AI Institute (HAI) conducted a study in which they designed a "pre-registered dataset of over 200 open-ended legal queries" to test AI products by LexisNexis (creator of Lexis+ AI) and Thomson Reuters (creator of Westlaw AI-Assisted Research and Ask Practical Law AI). The researchers found that these legal models hallucinate in 1 out of 6 (or more) benchmarking queries.
PlusIncident 16822 Rapports
D.C. Court of Appeals Struck Deutsche Bank National Trust Company Brief After Attorney Used Google Generative AI Search Tool and Filed Four Nonexistent Case Citations
2025-08-12
In Douglas v. Deutsche Bank National Trust Co., attorney Loishirl W. Hall acknowledged using Google's generative AI search tool to locate case authority and failing to verify citations before an appellate brief was filed. The D.C. Court of Appeals found four cited cases did not exist, said the filing misdirected the court and burdened judicial resources, struck Deutsche Bank's brief, and referred the matter for disciplinary review.
PlusEntités liées
Autres entités liées au même incident. Par exemple, si le développeur d'un incident est cette entité mais que le responsable de la mise en œuvre est une autre entité, ils sont marqués comme entités liées.
Entités liées
AI-assisted legal research systems
Incidents implicated systems
- Incident 16583 Report
State Farm Defense Counsel Acknowledged AI-Assisted Filings in Meni-Siliga v. A's Contractor, Inc. Contained Fabricated Legal Authorities
- Incident 16822 Report
D.C. Court of Appeals Struck Deutsche Bank National Trust Company Brief After Attorney Used Google Generative AI Search Tool and Filed Four Nonexistent Case Citations
Lawyers
Incidents involved as Deployer
- Incident 16583 Report
State Farm Defense Counsel Acknowledged AI-Assisted Filings in Meni-Siliga v. A's Contractor, Inc. Contained Fabricated Legal Authorities
- Incident 16822 Report
D.C. Court of Appeals Struck Deutsche Bank National Trust Company Brief After Attorney Used Google Generative AI Search Tool and Filed Four Nonexistent Case Citations