AI2030 Responsible AI Tools Marketplace

Open Source Tools Commercial Tools Research Papers AI Incidents

Chicago Office Address
111 North Wabash Ave.
Chicago, IL 60602
United States

info@ai2030.org

Follow Us

AI2030

Home
About Us
Membership
Sponsorship

Useful Links

Get Tickets
Contact Us
Events

Quick Links

Blog
Speakers
Contacts

Marketplace

Open Source Tools
Commercial Tools
Research Papers
AI Incidents

© 2026 AI 2030 | All Rights Reserved

Privacy Policy|Terms of Use

Back to AI Incidents

Incident #615·Misinformation

Colorado Lawyer Filed a Motion Citing Hallucinated ChatGPT Cases

June 13, 20234 reportsView on AIID

Description

A Colorado Springs attorney, Zachariah Crabill, mistakenly used hallucinated ChatGPT-generated legal cases in court documents. The AI software provided false case citations, leading to the denial of a motion and legal repercussions for Crabill, highlighting risks in using AI for legal research.

Actors

Alleged Deployers

zachariah-crabill

Alleged Developers

openai
chatgpt

Harmed Parties

zachariah-crabill's-client
zachariah-crabill
legal-system

Classification

Risk Domain

Misinformation

Risk Subdomain

3.1. False or misleading information

MIT Risk Profile

AIUnintentionalPost-deployment

Source

Databaseaiid

LicenseCC BY-SA 4.0

Related Incidents (Misinformation)

ChatGPT Reportedly Produced False Court Case Law Presented by Legal Counsel in Court

May 2023

Sports Illustrated Is Alleged to Have Used AI to Invent Fake Authors and Their Articles

Nov 2023

Seeming Pattern of Gemini Bias and Sociotechnical Training Failures Harm Google's Reputation

Research Papers on This Topic

Fast-DetectGPT: Efficient Zero-Shot Detection of Machine-Generated Text via Conditional Probability Curvature

450 citationsOct 2023

Why Language Models Hallucinate

371 citationsSep 2025

CIFAKE: Image Classification and Explainable Identification of AI-Generated Synthetic Images

283 citationsMar 2023

Degenerate Feedback Loops in Recommender Systems

265 citationsFeb 2019

Source Reports(4 total)

Colorado lawyer suspended for using AI platform to draft legal motion

cbsnews.com· Nov 2023

A stressed out rookie lawyer says he got fired after he used ChatGPT to do his job

businessinsider.com· Nov 2023

AI Incident Database (AIID), MIT AI Risk Initiative. Data from the AI Incident Database (AIID), MIT AI Risk Initiative. Licensed under CC BY-SA 4.0.

Feb 2024

These lawyers used ChatGPT to save time. They got fired and fined.

washingtonpost.com· Nov 2023

Colorado Springs attorney says ChatGPT created fake cases he cited in court documents | KRDO

krdo.com· Jun 2023