Purportedly AI-Manipulated Synthetic Media Allegedly Fuels False Reports of Natural Disasters and Accidents in China
Description
In China, purported AI tools were reportedly used to fabricate and disseminate false reports of disasters, including a landslide in Yunnan, an earthquake in Sichuan, and a sudden death after a traffic incident. On May 27, 2024, a real 5.0-magnitude earthquake occurred in Muli County, Sichuan, with no casualties and limited property damage. However, a social media post later falsely claimed the epicenter was in Xide County and exaggerated the event's severity, adding fabricated images of extensive destruction. The deployers of these false reports have since received administrative penalties from Chinese authorities for their actions.
Actors
Alleged Deployers
- yang-moumou
- tian-mou
- lou-moumou
Alleged Developers
- unknown-ai-developers
- deepfake-technology-developers
Harmed Parties
- yunnan-general-public
- xide-county-in-sichuan-residents
- sichuan-general-public
- muli-county-in-sichuan-residents
- chinese-general-public
- chinese-citizens
- chengcheng-county-shaanxi-residents
Classification
Risk Domain
Malicious Actors & MisuseRisk Subdomain
4.1. Disinformation, surveillance, and influence at scale
MIT Risk Profile
Source
Related Incidents (Malicious Actors & Misuse)
View all →Female Students at Westfield High School in New Jersey Reportedly Targeted with Deepfake Nudes
Oct 2023
ChatGPT Was Alleged to Have Aided Planning of Florida State University Mass Shooting
Apr 2025
Ongoing Purported AI-Assisted Identity Fraud Enables Unauthorized Access to Western Companies by North Korean IT Workers
Research Papers on This Topic
How Johnny Can Persuade LLMs to Jailbreak Them: Rethinking Persuasion to Challenge AI Safety by Humanizing LLMs
AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agents
Regulating ChatGPT and other Large Generative AI Models
Great, Now Write an Article About That: The Crescendo Multi-Turn LLM Jailbreak Attack