Legal professionals
Affecté par des incidents
Incident 7042 Rapports
Study Highlights Persistent Hallucinations in Legal AI Systems
2024-05-23
Stanford University’s Human-Centered AI Institute (HAI) conducted a study in which they designed a "pre-registered dataset of over 200 open-ended legal queries" to test AI products by LexisNexis (creator of Lexis+ AI) and Thomson Reuters (creator of Westlaw AI-Assisted Research and Ask Practical Law AI). The researchers found that these legal models hallucinate in 1 out of 6 (or more) benchmarking queries.
PlusIncidents involved as Deployer
Incident 16583 Rapports
State Farm Defense Counsel Acknowledged AI-Assisted Filings in Meni-Siliga v. A's Contractor, Inc. Contained Fabricated Legal Authorities
2026-03-31
In Fa'alagilagi Meni-Siliga v. A's Contractor, Inc., et al., attorneys representing State Farm acknowledged that AI-assisted motions contained fabricated and otherwise inaccurate legal authorities. Attorney Jacquelene Robinson said she used the legal AI tool Irys and failed to verify some citations. Opposing counsel identified the errors, after which the firm apologized and filed corrected versions.
PlusIncident 17243 Rapports
Oklahoma Judge Reportedly Used ChatGPT-Generated Fictitious Case Citations in Family-Law Order
2025-11-19
Stephens County, Oklahoma, Associate District Judge Lawrence Wheeler reportedly used ChatGPT for legal research while preparing a family-law order that cited at least two nonexistent cases. The order denied a request for a psychological evaluation and reprimanded the requesting attorney; Wheeler later vacated it after the attorney challenged it before the Oklahoma Supreme Court.
PlusIncident 18133 Rapports
Five Reportedly Fictitious Citations Suspected of Being AI-Generated Led to a Costs Order in a London Housing Case
2025-06-06
In a London housing case, England's High Court found that a barrister cited five reportedly fictitious cases and ordered her and the Haringey Law Centre, a legal aid charity, to pay £4,000 in wasted costs. Opposing counsel alleged AI use. The barrister denied using generative AI. The Divisional Court identified AI use as one of two possible explanations for the citations.
PlusIncident 7042 Rapports
Study Highlights Persistent Hallucinations in Legal AI Systems
2024-05-23
Stanford University’s Human-Centered AI Institute (HAI) conducted a study in which they designed a "pre-registered dataset of over 200 open-ended legal queries" to test AI products by LexisNexis (creator of Lexis+ AI) and Thomson Reuters (creator of Westlaw AI-Assisted Research and Ask Practical Law AI). The researchers found that these legal models hallucinate in 1 out of 6 (or more) benchmarking queries.
PlusEntités liées
Autres entités liées au même incident. Par exemple, si le développeur d'un incident est cette entité mais que le responsable de la mise en œuvre est une autre entité, ils sont marqués comme entités liées.
Entités liées
Courts
Affecté par des incidents
- Incident 18133 Report
Five Reportedly Fictitious Citations Suspected of Being AI-Generated Led to a Costs Order in a London Housing Case
- Incident 16822 Report
D.C. Court of Appeals Struck Deutsche Bank National Trust Company Brief After Attorney Used Google Generative AI Search Tool and Filed Four Nonexistent Case Citations