SafetyTrustworthinessTransparencycs.CL
Detecting misinformation through Framing Theory: the Frame Element-based Model
Guan Wang, Rebecca Frederick, Jinglong Duan, William Wong, Verica Rupar, Weihua Li, Quan Bai
February 19, 2024
Journal of Computational Social Science
20 citations
Key Takeaways
-
Framing matters as much as facts: The paper demonstrates that accurate information can become misinformation simply through how it's presented or "framed." This means fact-checking alone is insufficient—we must also examine how information is being portrayed to audiences.
-
Generative AI poses new misinformation risks: The research highlights that AI models capable of generating text can create misleading narratives by strategically reframing factual information, representing an emerging threat that traditional misinformation detection tools may miss.
-
Current AI systems overlook narrative manipulation: The authors identify that the AI community has under-explored how narrative frames are manipulated to spread misinformation, suggesting existing detection systems have a significant blind spot in addressing this sophisticated form of deception.
-
Advanced AI can help detect frame-based misinformation: The paper proposes using Large Language Models and deep neural networks to identify when accurate facts are being reframed in misleading ways, offering a technical pathway to address this gap in responsible AI development.
-
Interdisciplinary approaches strengthen AI safety: By drawing on communication and framing theories from outside computer science, the research demonstrates that responsible AI development benefits from insights across disciplines to catch subtle forms of manipulation that purely technical approaches might miss.
Abstract
In this paper, we delve into the rapidly evolving challenge of misinformation detection, with a specific focus on the nuanced manipulation of narrative frames - an under-explored area within the AI community. The potential for Generative AI models to generate misleading narratives underscores the urgency of this problem. Drawing from communication and framing theories, we posit that the presentation or 'framing' of accurate information can dramatically alter its interpretation, potentially leading to misinformation. We highlight this issue through real-world examples, demonstrating how shifts in narrative frames can transmute fact-based information into misinformation. To tackle this challenge, we propose an innovative approach leveraging the power of pre-trained Large Language Models and deep neural networks to detect misinformation originating from accurate facts portrayed under different frames. These advanced AI techniques offer unprecedented capabilities in identifying complex patterns within unstructured data critical for examining the subtleties of narrative frames. The objective of this paper is to bridge a significant research gap in the AI domain, providing valuable insights and methodologies for tackling framing-induced misinformation, thus contributing to the advancement of responsible and trustworthy AI technologies. Several experiments are intensively conducted and experimental results explicitly demonstrate the various impact of elements of framing theory proving the rationale of applying framing theory to increase the performance in misinformation detection.
17 pages, 9 figures, 7 tables
Paper Info
arXiv ID2402.15525
PublishedFebruary 19, 2024
Citations
20
Relevance82%
VenueJournal of Computational Social Science
TypeJournalArticle
Categorycs.CL
Responsible AI Topics
SafetyTrustworthinessTransparency
Links
Citation data from Semantic Scholar