AI Transcription Tool Whisper Reportedly Inserting Fabricated Content in Medical Transcripts
Description
OpenAI's AI-powered transcription tool Whisper, used to translate and transcribe audio content such as patient consultations with doctors, is advertised as having near “human level robustness and accuracy.” However, software engineers, developers and academic researchers have alleged that it is prone to making up chunks of text or even entire sentences and that some of the hallucinations can include racial commentary, violent rhetoric, and even imagined medical treatments.
Actors
Alleged Deployers
- openai
Alleged Developers
- openai
Harmed Parties
- patients
- patients-reliant-on-whisper
- medical-practitioners-reliant-on-whisper
Classification
Risk Domain
MisinformationRisk Subdomain
3.1. False or misleading information
MIT Risk Profile
Source
Related Incidents (Misinformation)
View all →Research Papers on This Topic
Fast-DetectGPT: Efficient Zero-Shot Detection of Machine-Generated Text via Conditional Probability Curvature
Why Language Models Hallucinate
CIFAKE: Image Classification and Explainable Identification of AI-Generated Synthetic Images
Degenerate Feedback Loops in Recommender Systems