Description: OpenAI's AI-powered transcription tool Whisper, used to translate and transcribe audio content such as patient consultations with doctors, is advertised as having near “human level robustness and accuracy.” However, software engineers, developers and academic researchers have alleged that it is prone to making up chunks of text or even entire sentences and that some of the hallucinations can include racial commentary, violent rhetoric, and even imagined medical treatments.
Entities
View all entitiesAlleged: OpenAI developed and deployed an AI system, which harmed patients , Patients reliant on Whisper and Medical practitioners reliant on Whisper.
Incident Stats
Incident ID
827
Report Count
1
Incident Date
2024-10-26
Editors
Daniel Atherton
Incident Reports
Reports Timeline
apnews.com · 2024
- View the original report at its source
- View the report at the Internet Archive
SAN FRANCISCO (AP) --- Tech behemoth OpenAI has touted its artificial intelligence-powered transcription tool Whisper as having near "human level robustness and accuracy."
But Whisper has a major flaw: It is prone to making up chunks of tex…
Variants
A "variant" is an incident that shares the same causative factors, produces similar harms, and involves the same intelligent systems as a known AI incident. Rather than index variants as entirely separate incidents, we list variations of incidents under the first similar incident submitted to the database. Unlike other submission types to the incident database, variants are not required to have reporting in evidence external to the Incident Database. Learn more from the research paper.
Similar Incidents
Did our AI mess up? Flag the unrelated incidents
Wikipedia Vandalism Prevention Bot Loop
· 6 reports
All Image Captions Produced are Violent
· 28 reports
Collection of Robotic Surgery Malfunctions
· 12 reports
Similar Incidents
Did our AI mess up? Flag the unrelated incidents
Wikipedia Vandalism Prevention Bot Loop
· 6 reports
All Image Captions Produced are Violent
· 28 reports
Collection of Robotic Surgery Malfunctions
· 12 reports