Incident #541·Misinformation

ChatGPT Reportedly Produced False Court Case Law Presented by Legal Counsel in Court

May 4, 202358 reportsView on AIID

Description

A lawyer in Mata v. Avianca, Inc. used ChatGPT for research. ChatGPT hallucinated court cases, which the lawyer then presented in court. The court determined the cases did not exist.

Actors

Alleged Deployers

steven-a.-schwartz
peter-loduca

Alleged Developers

openai

Harmed Parties

roberto-mata
peter-loduca
steven-a.-schwartz

Classification

Risk Domain

Misinformation

Risk Subdomain

3.1. False or misleading information

MIT Risk Profile

AIUnintentionalPost-deployment

Source

Databaseaiid

LicenseCC BY-SA 4.0

View on AIID

Related Incidents (Misinformation)

View all →

#616

Sports Illustrated Is Alleged to Have Used AI to Invent Fake Authors and Their Articles

Nov 2023

#645

Seeming Pattern of Gemini Bias and Sociotechnical Training Failures Harm Google's Reputation

Feb 2024

#39

Deepfake Obama Introduction of Deepfakes

Research Papers on This Topic

Fast-DetectGPT: Efficient Zero-Shot Detection of Machine-Generated Text via Conditional Probability Curvature

450 citationsOct 2023

Why Language Models Hallucinate

371 citationsSep 2025

CIFAKE: Image Classification and Explainable Identification of AI-Generated Synthetic Images

283 citationsMar 2023

Degenerate Feedback Loops in Recommender Systems

265 citationsFeb 2019

Source Reports(58 total)

View all on AIID

Lawyers have real bad day in court after citing fake cases made up by ChatGPT

arstechnica.com· Jun 2023

Lawyers fined for filing bogus case law created by ChatGPT

cbsnews.com· Jun 2023