Legal professionals
Incidents Harmed By
Incident 7042 Report
Study Highlights Persistent Hallucinations in Legal AI Systems
2024-05-23
Stanford University’s Human-Centered AI Institute (HAI) conducted a study in which they designed a "pre-registered dataset of over 200 open-ended legal queries" to test AI products by LexisNexis (creator of Lexis+ AI) and Thomson Reuters (creator of Westlaw AI-Assisted Research and Ask Practical Law AI). The researchers found that these legal models hallucinate in 1 out of 6 (or more) benchmarking queries.
MoreIncidents involved as Deployer
Incident 16583 Report
State Farm Defense Counsel Acknowledged AI-Assisted Filings in Meni-Siliga v. A's Contractor, Inc. Contained Fabricated Legal Authorities
2026-03-31
In Fa'alagilagi Meni-Siliga v. A's Contractor, Inc., et al., attorneys representing State Farm acknowledged that AI-assisted motions contained fabricated and otherwise inaccurate legal authorities. Attorney Jacquelene Robinson said she used the legal AI tool Irys and failed to verify some citations. Opposing counsel identified the errors, after which the firm apologized and filed corrected versions.
MoreIncident 17243 Report
Oklahoma Judge Reportedly Used ChatGPT-Generated Fictitious Case Citations in Family-Law Order
2025-11-19
Stephens County, Oklahoma, Associate District Judge Lawrence Wheeler reportedly used ChatGPT for legal research while preparing a family-law order that cited at least two nonexistent cases. The order denied a request for a psychological evaluation and reprimanded the requesting attorney; Wheeler later vacated it after the attorney challenged it before the Oklahoma Supreme Court.
MoreIncident 18133 Report
Five Reportedly Fictitious Citations Suspected of Being AI-Generated Led to a Costs Order in a London Housing Case
2025-06-06
In a London housing case, England's High Court found that a barrister cited five reportedly fictitious cases and ordered her and the Haringey Law Centre, a legal aid charity, to pay £4,000 in wasted costs. Opposing counsel alleged AI use. The barrister denied using generative AI. The Divisional Court identified AI use as one of two possible explanations for the citations.
MoreIncident 7042 Report
Study Highlights Persistent Hallucinations in Legal AI Systems
2024-05-23
Stanford University’s Human-Centered AI Institute (HAI) conducted a study in which they designed a "pre-registered dataset of over 200 open-ended legal queries" to test AI products by LexisNexis (creator of Lexis+ AI) and Thomson Reuters (creator of Westlaw AI-Assisted Research and Ask Practical Law AI). The researchers found that these legal models hallucinate in 1 out of 6 (or more) benchmarking queries.
MoreRelated Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
Related Entities
Courts
Incidents Harmed By
- Incident 18133 Reports
Five Reportedly Fictitious Citations Suspected of Being AI-Generated Led to a Costs Order in a London Housing Case
- Incident 16822 Reports
D.C. Court of Appeals Struck Deutsche Bank National Trust Company Brief After Attorney Used Google Generative AI Search Tool and Filed Four Nonexistent Case Citations